The Educational Record 


Published Quarterly by 


The American Council on Education 








Volume 15 January, 1934 








Editor: 
C. R. MANN 


CONTENTS 


The Potentialities of the Youth Movement in America 
Henry A. Wallace 


Accrediting Schools and Colleges 
George F. Zook 


The Administrator and the Testing Program 
Harry W. Chase 


Religious Instruction at the University of Michigan 
Alexander G. Ruthven 


Coordinated Examining and Testing Programs 
Ben D. Wood 


Units and Placement 
Carl C. Brigham 


The Technique of Constructing Tests 
E. F. Lindquist 


Judging and Recording Pupil Characteristics 
Eugene R. Smith 


Measurement in Educational Experimentation 
Max McConn 


Annual Subscription, $2.00 


Entered as second-class matter June 8, 1932, at the Post Office at 
Washington, D. C., under the Act of August 24, 1912. 








CopyriGut, 1934 
AMERICAN CoUNCIL ON EDUCATION 





The Potentialities of the Youth 
Movement in America’ 


HEN the 40,000 undisciplined slaves, known as the 

children of Israel, left Egypt, it was possible for them 

to reach the Promised Land within a few months. 
But they were not fit to go in and take possession, because the 
old generation thought of everything in terms of the flesh- 
pots of Egypt. It was necessary for the young generation, 
hardened by travels in the wilderness, to come to maturity 
before the Promised Land could be possessed. 

We have left the fleshpots of Egypt. We are on our way. 
The Promised Land is at hand, and the only question is 
whether the old generation is fitted to go in and take pos- 
session. 

We have never had in America a youth movement worthy 
of the name. Since the war, we have heard much about 
Flaming Youth and the rebellion of youth in this country; 
but these terms have merely described a rather smart-alecky, 
premature sophistication which was the natural reaction to 
the hypocritical puritanism of certain elements of the older 
generation. Strange to say, when the Flaming Youth of the 
war period entered early middle age, it found itself equipped 
with habits of excessive drinking and forced gaiety which have 
proved positively repulsive to some of the present younger 
generation. There may be something exciting about wildness 
when it seems to be new and novel, but to engage in the more 
or less obligatory wildness of an older generation is another 
matter. There is no sense of adventure in that. There is 
nothing more repulsive to youth than a ritualized elderly 
obscenity. 

Frankly, I think all of us feel it is a shame that the unorgan- 
ized youth movements of America should have been so identi- 
fied in the public mind with matters of personal habits. After 


2 Address before the National Student Federation, Washington, D. C., Decem- 
ber 31, 1933. 
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all, these things do not change a great deal from generation 
to generation. There are always certain elders to be shocked 
and certain youths who in the innocence of their hearts get a 
great kick out of doing the shocking. This kind of thing, 
while it may cause heartbreaks in certain homes, is without 
fundamental significance. I think we are all agreed that noth- 
ing of this sort ever has or ever will constitute a true youth 
movement. 

A true youth movement must be a new, vital, adventurous 
approach to the potentialities of the coming age. There has 
never been anything of this sort in the United States because 
hitherto our youth have seen fit to disagree with their elders 
only on superficialities. Our college life has expressed its 
vitality in such rackets as organized football, or college activ- 
ities of a sort which remain essentially the same from genera- 
tion to generation. 

The depression of the past three years should create a 
genuine youth movement. Hundreds of thousands of boys and 
girls who thought they were going to slide through college 
on father’s money now know that either they will have to work 
their way through college or they cannot go at all. Thou- 
sands of students who have recently graduated cannot get jobs. 
Of necessity, therefore, hundreds of thousands of young 
people are asking the question, ‘““Why should this great grief 
have come to us? What has suddenly gone wrong with civil- 
ization? What can we do to fix it up?” 

They blame their parents and try to get to the bottom of 
things. This is fine. Go ahead and blame us all you want. 
My only fear is that you won’t strive desperately enough to 
understand. As I read about foreign youth movements, I am 
led to think that there is something altogether too smug, com- 
placent, and self-satisfied about the youth of the United States. 
There is more to college life than talking about football scores 
and college dances. Of course, the students who take part in 
athletics, or in running the school paper, are perfectly. right 
when they suggest that there is something more to college 
than merely studying. But I am wondering if the extra cur- 
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POTENTIALITIES OF THE YOUTH MoveMENT 5 


ricular activities as formalized and commercialized in 90 per 
cent of our colleges really furnish anything so extraordinarily 
worth while. As a matter of fact, many of us are beginning 
to wonder if the colleges themselves are as vital as they should 
be in furnishing the leadership to enable the youth of today 
to grapple in an adventurous way with the realities of the 
coming day. Originally schools grew up around the striking 
personality of some one individual or group of individuals who 
were passionately convinced of the need for certain changes. 
Being continually consumed with the fire of their convictions, 
they lit up the realities of the immediate future for an entire 
generation. Afterward, the faculties gather, the piles of brick 
and stone are erected, but the fire all too often subsides. An 
orderly, sustained course of study may take its place. But an 
orderly, sustained course of study, while it is exceedingly im- 
portant in its own way, is not sufficient for a youth movement. 

I think it is a mistake for an older man to be dogmatic con- 
cerning the objectives of a youth movement. The young 
people themselves have keen intuition. If they approach the 
problems of our civilization with a strong desire to see some- 
thing worth-while accomplished, I am sure that all of us will 
be surprised at how rapidly the new world can be brought into 
being. 

It seems to me that youth instinctively believes in the doc- 
trine of the New Deal as against special privilege. It sees 
no reason why one young fellow should inherit a million 
dollars when he has no more ability to manage the money for 
the benefit of society than a million other youths. The matter 
of passing wealth on from one generation to another in such 
a way as to increase the wealth producing power of society is 
a matter of the very greatest concern. Putting the money of 
the dying generation into the hands of the Government by 
means of heavy inheritance taxes furnishes an apparently easy 
answer, but we all must remember that fundamentally sound 
answers are probably not obtained thus easily. The question 
is one of bringing about a continuous flow of capital into those 
industries for which there will be an adequate future demand. 
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Where do we want to go? What is the fundamental desire 
of this next generation? 

Hitherto the desire of the coming generation was always to 
exploit the frontier. When the frontier passed out of exist- 
ence about the time of the war, we turned our desires for a 
time to the exploitation of marvelous new inventions, but we 
had gone into this field only a short distance when we dis- 
covered that we couldn’t go so very far with these new inven- 
tions until we had perfected a mechanism for social justice 
which would enable us accurately to balance production with 
consumption and to steer this country in its relationship with 
other nations in a decent, sensible way. 

We have not yet perfected such a mechanism. The New 
Deal merely says that we want such a mechanism and are 
striving desperately to get it. To that extent, I feel free to 
say definitely that the New Deal is a youth movement. The 
men who have proposed it, I fear, are in somewhat the same 
situation as those who led the children of Israel out of Egypt. 
Probably they will not live to see you people, the youth, come 
into the Promised Land, but they can send out spies to deter- 
mine its nature and can stand with the Lord on the mountain 
before they die and speculate concerning its possibilities. 

I have no doubt that many of the youth are soft-fibered 
and would like to return to the fleshpots of Egypt. It would 
be nice to go back to that simple world where we were taken 
care of even though we did have to make bricks without straw. 
But fortunately we can’t go back even if we want to. The 
world has definitely changed and we have to go forward. The 
same old economic laws apply, but they apply against the 
background of a new situation. We are having to do new 
things in a new way. We have started on an adventure which 
is as stimulating as that which confronted Columbus when he 
set sail in 1492. Our goal is the rediscovering of America— 
an America rich in human, social resources. 

As the youth movement sets forth on its voyage of adven- 
ture, some of the most important pieces of equipment are 
vigor, intense interest, frankness, and lack of prejudice. Nar- 
rowness, bitterness and dogmatism must be left behind. It is 
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POTENTIALITIES OF THE YOUTH MOoOvEMENT 7 


up to youth to create simultaneously the new wine of the spirit 
and the new vessels capable of holding that wine. A narrow, 
mean, petty nationalism will not be strong enough to hold the 
spirit of the next generation; neither will a cloudy, idealistic 
internationalism. I trust also you will not be too easily de- 
luded by those socialistic, communistic ideas which lay emphasis 
on the economic man to the exclusion of the artistic and relig- 
ious man. In brief, the youth movement might well be famil- 
iar with all the “isms” of the older generation without being 
definitely committed for or against any of them. You will 
have to put the facts which confronted your elders into a new 
and more-living relationship. Think and feel with the great- 
est intensity, but don’t be prematurely logical and set in your 
ways. 

One capacity which I trust both the administrators of the 
New Deal and the members of the youth movement will have 
in common is the ability to disagree harmoniously about the 
superficialities as long as there is agreement on the funda- 
mental attitude. That fundamental attitude as I see it is a 
pliable willingness to face the facts and a passionate eagerness 
to shape those facts to bring about a better balanced life, not 
only in this country but in the whole world. We cannot recog- 
nize those who are interested primarily in short-time monetary 
profits for certain industries or for certain classes. Such 
people have the special privilege concept of government, a 
concept which may be appropriate at certain stages in history, 
but which, I trust, will not be successfully revived in these days 
when our machinery for production, communication, trans- 
portation, and consumption can be so easily operated on a 
continental and a worldwide scale. Yes, both the New Deal 
and the youth movement need pliable minds with which to 
reassemble the facts, broad concepts and the ability to apply 
these concepts to specific situations in a precise, practical way. 
Long after the present administration has passed out of office 
and you have reached the middle age of your voting life, this 
problem will still be with you. You will doubtless have seen 
the American people swing several times back from extreme 
liberalism to extreme conservatism. But, all the time, I trust 
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that you will do your best to keep alive the dynamic liberal 
spirit which animated Theodore Roosevelt and Woodrow 
Wilson and which now finds such a charming and powerful 
embodiment in Franklin D. Roosevelt. 

It is interesting to note how many of the active participants 
in the New Deal were first stirred up by the fiery leadership 
of Old Teddy and then again by the resolute righteousness of 
Woodrow Wilson. Ina recent Cabinet meeting at least three 
of the eleven men there seated were Bull Moosers in 1912, and 
all of them had been inspired in one way or another by the 
New Freedom of Woodrow Wilson. 

The young men of twenty years ago who followed with 
such implicit faith the rugged vigor of Teddy and the idealism 
of Wilson were greatly disillusioned by the politics of the 
twenties. It seemed as if American progressivism was forever 
buried. Some of the disillusioned, in their despair accumulat- 
ing age, fat, and property, became conservative stand-patters. 
Others, knowing the lessons of history and the fundamental 
nature of the American people, patiently bided their time. I 
am mentioning this because you likewise will see a day come 
when the ideals to which you now wish to devote your life 
will apparently have no following; but sooner or later, if your 
ideals are soundly conceived, the time will come when the 
American people will be willing to give them political ex- 
pression. 

Woodrow Wilson called attention to the desirability of 
having American political forces express themselves through 
a conservative and a liberal party. He felt hampered by the 
fact that there were conservatives in both parties and progres- 
sives in both parties. This political anomaly now seems to be 
slowly in process of correction. When this process is accom- 
plished, there will be a tremendously increased interest in 
politics on the part of the youth of the land, because the parties 
will then stand for definitely different attitudes. 

To those of you who are instinctively progressive by nature, 
I would suggest the advisability of cultivating patience and 
tolerance. It won’t do to go around all the time as if you 
were just getting ready to bite somebody. After a time the 
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POTENTIALITIES OF THE YOUTH MOVEMENT 9 


excitement wears off, and you begin to wonder what it was that 
so excited you when you were young and foolish. To those of 
you who are conservative by nature, I would suggest the 
desirability of remembering that there is much more to life 
than property and wealth. Many of the truly richest indi- 
viduals have had neither. It is a, function of the conservative 
to point out the practical difficulties of the progressive’s ideal- 
istic plans. But the conservatives should remember that many 
of their theories about money, property, and wealth are at 
bottom unreal and will so be proved by history. Neither pro- 
gressives nor conservatives have a monopoly on idealistic 
fantasy. I am assuming, of course, that the majority of the 
members of any youth movement will be progressives, but that 
a considerable portion of them will turn conservative as they 
lose their hair and expand their waistlines and their bank 
accounts. While it is the conservatives’ function to be in- 
tensely practical, that ought not to be confused with simply 
being selfish; and while it seems to be the progressives’ func- 
tion to be idealistic, that idealism ought to be based on poten- 
tial realities rather than on vague mystic emotion. 

Those of you in whom I am most interested are those who, 
even though they are wealthy twenty years hence, will still 
have the same fiery interest and faith in the future of mankind 
that they have today. You are forming your ideals today; 
you will be putting them into active use twenty years hence. 

Henry A. WALLACE, 
United States Department 
of Agriculture. 








Accrediting Schools and Colleges’ 


INTRODUCTION BY DEAN HERBERT E. HAWKES 


We are specially fortunate in the next speaker who will 
address us this morning. I feel that it is a very high compli- 
ment to this group and to the associations which are repre- 
sented here that Commissioner Zook should leave the heavy 
responsibilities which burden him in Washington and come 
here to address us. As you know, Commissioner Zook has 
been in the forefront of the hottest battle in the North Central 
Association in the question of accreditation of schools and col- 
leges, and the topic on which he speaks is a topic on which no 
one could speak with greater authority. It is a pleasure to 
present Dr. George F. Zook, United States Commissioner of 
Education. 


ADDRESS BY COMMISSIONER ZOOK 


“TF T will be a dangerous, a most dangerous experiment, 
to hold colleges subject to the rise and fall of popular 
parties, and the fluctuations of political opinions. Bene- 

factors will have no certainty of effecting the object of their 
bounty; and learned men will be deterred from devoting them- 
selves to the service of such institutions, from the precarious 
title of their offices. Colleges and halls will be deserted by all 
better spirits, and become a theater for the contentions of 
politics. Party and faction will be cherished in the places 
consecrated to piety and learning.” 

So thundered Daniel Webster in his concluding arguments 
before the United States Supreme Court in the famous Dart- 
mouth College case more than 100 years ago. 

The argument made a deep impression on the court. In 
the decision the Chief Justice, John Marshall, declared that 
“no man ever did or will found a college, believing at the 
time that an act of incorporation constitutes no security for 


2 Address at the Second Joint Educational Conference, New York, Nov. 2, 1933. 
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ACCREDITING SCHOOLS AND COLLEGES 11 


the institution; believing that it is immediately to be deemed 
a public institution, whose funds are to be governed and 
applied, not by the will of the donor, but by the will of the 
legislature. All such gifts are made in the pleasing, perhaps 
delusive hope, that the charity will flow forever in the chan- 
nel which the givers have worked out for it.” 

Remembering the sentimental appeal for liberty of teach- 
ing that went with the founding of each of the colonial col- 
leges by the several religious denominations and the deep 
emotions that were stirred by the issue of freedom in teach- 
ing which seemed to be at stake in the Dartmouth College 
decision a century ago, it is difficult to resist vigorous ap- 
plause for every effort at self-determination and self-govern- 
ment undertaken in our schools and colleges. 

Yet nowhere in America does the voice of individual or 
institutional freedom speak with the same vigor or carry the 
same conviction as it did a century or so ago. The indi- 
vidual comes to realize that there are advantages to be had 
from social living even though he may have to surrender 
certain liberties. What is true of individuals holds equally 
true for institutions, both business and educational. The 
stern battle for independence of action which seemed so nec- 
essary then is often not impressive now. 

The Dartmouth College decision guaranteed the liberties 
already granted or to be granted in college charters. As such 
it seemed a veritable rock of educational liberty. But it also 
served to warn the rising democratic sentiment that if it 
wished to make college education serve its purposes it must 
be careful to leave a way for future public opinion to express 
itself. Hence states began to restrict the liberties given to 
individual colleges in charters. In some instances legisla- 
tures placed authority relative to institutional powers in the 
hands of a board or commission. In others the state consti- 
tution specifically reserved the right to amend or modify the 
powers which may be exercised by colleges founded there- 
after. Therefore, when the Berea College case came up 
for decision, the courts made a very different disposition of 
the matter. The authority of the state to regulate the 
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affairs of the college was vindicated. Berea College was 
subjected to the social requirements of the people of Ken- 
tucky. There can be no doubt that the social philosophy 
behind the Berea College case is at least equally representa- 
tive, and I believe more so, of the present genius of the 
American people than that so ably set forth by Daniel Webster 
more than a century ago. 

Finally, the rapid extension of public higher education 
through universities, land grant colleges, teachers’ colleges, 
and now, junior colleges is merely another way of declaring 
the interest which the public has in the conduct of higher 
education as well as in all other phases of social life. 

Theoretically and practically I believe that we must accept 
a large measure of social control as desirable and necessary 
both for schools and colleges. I will not say that I believe 
it is always wisely exercised—no manifestation of democracy 
is—but ordinarily I am convinced that it is wiser to guide it 
than it is to resist it. 

I do not believe, therefore, that it is any more possible 
for a college or a school to live in “splendid isolation” than 
it is for a country or for an individual to do so. Changes in 
national economic circumstances, reorganizations in the pro- 
gram of education, modifications of popular social philosophy 
play an unending tattoo on all social institutions including our 
schools and colleges. Ultimately upon every one of them pub- 
lic opinion leaves its impression; and each goes about the 
business of responding to it, some sooner, some later. One 
must, therefore, accept, I am convinced, a large amount of 
social control in all forms of education. 

Granted, but does it necessarily follow that social control 
shall be equally restrictive in all forms of education? Is it 
not clear that there is more public necessity for restraint of 
liberty in connection with the several forms of professional 
and technical education than is necessary or wise in the wide 
field of liberal education? I subscribe to this belief. The 
practice of a profession is society’s affair. The practice of a 
liberal education is largely, though not exclusively, the in- 
dividual’s affair. A liberal education is partially for the 
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satisfaction of individual wants of little or no concern to 
society in general or to any other individual. On the other 
hand, what is taught in the medical or dental curriculum 
affects the very lives of individuals. The law school cannot 
exist for a day without discussing great problems of human 
relations which are vital to our social existence. Hence we 
accept with little question legal restraints in most fields of 
professional and technical education which do not seem to us 
necessary or desirable in the field of liberal education. 

There are, therefore, some leaders of educational thought 
who question whether there is any real necessity for legal 
control or for control of any type of liberal arts colleges and 
universities. Those who hold to this belief fail to keep in 
mind the sordid history of “diploma mills” in this country. 
Very few states have been spared this demonstration of 
chicanery in the name of educational liberty. I have often 
wondered what Daniel Webster and John Marshall would 
have thought if they had read the following advertisement 
years ago: 


“We can legally incorporate you a school for anywhere. 
You can teach and confer degrees. The United States Incor- 


porating Company, 1917 Seventh Street, N.W., Washing- 
ton, D. C.” 


Perhaps in the light of a few such illustrations as this, 
even they might admit today that in the public interest there is 
something to be said in favor of some limitation on the liber- 
ties which institutions may exercise. 

I have stated that society needs a way or ways of making 
its needs and conclusions articulate to the schools and colleges. 
Is this not the task and responsibility of the governing board 
authorized by the charter or the law establishing the insti- 
tution? Upon them public opinion beats continuously, and 
the fact that they do not always pursue a course of action 
exactly in line with the apparent demands of society at the 
moment may ultimately prove both wise and farsighted. This 
assumption is correct, and I for one believe that educators 
have been altogether too remiss in appreciating and acknowl- 
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edging the days and years of unselfish attention which thou- 
sands of men and women have given to the schools and higher 
institutions in whose service they have enlisted as members 
of governing boards. Some institutions have been blessed 
through a long history with many wise members of the govern- 
ing board. All have been fortunate in securing at least a 
few such persons. But after all has been said in praise of 
governing boards that can and should be said, is not the 
story of the way in which they have interpreted the needs 
of American life to school and college authorities generally 
a very disappointing one? Governing boards have, as every- 
one knows, a long catalog of sins—mostly sins of omission— 
which might be paraded at length; but I will refrain from 
elaborating on the obvious. I wish merely to have you join 
with me in concluding that as interpreters of ‘their constitu- 
ency and of American scientific and social life, governing 
boards fall far short of their opportunities and responsibili- 
ties. Obviously society needs other means of interpreting 
itself to the schools and colleges. 

The regular and final method which the American people 
use for the expression of their views on education as well as 
all other matters of common concern is the law. Year after 
year state legislative mills, composed of the elected agents 
of the people, grind out volumes of laws among which one 
sometimes finds a law dealing with education. Occasionally 
in the mass of this state legislation one finds real trends of 
policy not always in line with the desires of educational 
administrators, as, for example, the increasing centralization 
of the administration of public higher education within the 
states. In some of these matters the state legislatures have 
been wiser than college administrators and boards of trustees 
combined. State legislatures as a means of expressing public 
opinion about education are not, therefore, a complete fail- 
ure. They certainly have not been guilty of all the appre- 
hensions of Daniel Webster. In general, however, formal 
legislative law is not a successful method of keeping the 
educational institutions abreast of public needs and desires. 
Legislatures are too far away from and too little acquainted 
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with the problems involved to give a great deal of intelligent 
attention to them. As a means of preserving quality of work 
within institutions, they are, except in minor instances, a total 
failure. Even when evident good is accomplished temporarily 
by writing standards into the law relative, for example, to the 
endowment required of a college or the requirements for pre- 
paring students to enter the professions, including teaching, 
these standards soon prove to be inadequate or, worse, out 
of date. 

The best that the law can do for the schools and colleges, 
therefore, outside of legalizing the establishment of their 
governing boards, is to authorize the creation of public off- 
cials who have power to set up certain requirements for the 
maintenance of proper standards of educational work. Often 
this is done indirectly, because of the presence of old charters 
granting extensive privileges to the colleges, by setting up a 
requirement that individuals who wish to qualify for entrance 
into the professions or into teaching must have completed 
courses of study in institutions possessing certain facilities. 
The regulations of state authorities are much better than 
formal legislative law because regulations can be and gen- 
erally are more flexible than statute law. Furthermore, the 
officials who make them are closer to and understand the 
problems better. They may even, indeed in some instances 
often do, carry on extensive study of situations before issuing 
their decrees or they may lean heavily on the advice of 
accrediting agencies. 

Up to this point I have endeavored to show that schools 
and colleges are organizations established by society for a 
social purpose, and that no matter how much legal liberty 
they may enjoy they must and should, just as in the case of 
all other social institutions, be subjected constantly to the 
scrutiny, criticism, and even regulation of the society in 
which they live and which they serve. I am convinced, there- 
fore, that in general it is this criticism and regulation which 
helps powerfully to keep them abreast of changing social 
needs. All of these agencies of society, however, the govern- 
ing boards of schools and colleges, the laws passed by state 
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legislatures, and the regulations of state educational authori- 
ties have exhibited obvious deficiencies. Therefore, while I am 
convinced that all of these agencies of society have con- 
tributed notably to the success and progress of schools and 
colleges, yet experience shows us that they are not enough. 
Particularly they are ineffective in the realm of institutional 
quality. 

In the realm of quality of educational work there is, how- 
ever, the same need of effective means of criticism which will 
result in action as in other aspects of its activities. Obviously 
in this respect only the schools and colleges themselves acting 
jointly are in a position to formulate the best practices and 
the most accepted standards. Such a demand and such a 
realization gave rise to what we now know as the accrediting 
agency. An accrediting association such as the Middle States 
Association is the cooperative venture of a large number of 
schools and colleges which are earnestly seeking first to ascer- 
tain what are the best standards of educational work, and 
secondly what are the effective ways and means of bringing 
these standards to the attention of the schools and higher 
institutions within its constituency. 

What are its virtues as against other agencies of society? 
In the first place, it serves as a protection to institutious 
against the hasty and ill advised actions of state legislatures 
and even state educational authorities. Indeed, its standards 
and lists of accredited institutions help local authorities to 
elevate the tone and performance of local institutions which 
would otherwise be impossible. 

Secondly, it is not a debating society only. It has enough 
authority so that its conclusions carry weight. It can get 
something done. Finally, its conclusions and its actions are 
the cooperative work of the institutions themselves and as 
such are subject to constant mutual criticism and modification. 
If we had no such agency, we could better appreciate how 
sorely they would be needed. The fact that they grow in im- 
portance yearly in spite of obvious deficiencies is a testimonial 
to the continued need of them in this country. 
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METHODS OF ACCREDITING 


The liberty in education of which the people are most 
jealous is the subject-matter content itself. Hence in America 
any system of final examinations, so usual in Europe, except 
possibly those in distinctly professional fields, has been looked 
upon with suspicion. This is particularly true relative to the 
field of general cultural education where the quality of prep- 
aration for personal and social life seems constantly to be in 
question. —The American people do not believe that there is 
a general culture which may be defined in meticulous details. 
They prefer as yet at least to experiment a good deal before 
they allow it to crystallize. 

Fear of government in educational affairs and yet a reali- 
zation that there must be some means of educational control 
and guidance produced the accrediting agency. Fear of sub- 
ject-matter control through examinations or otherwise drove 
the accrediting agencies to exercise their control through a 
definition of the minimum external conditions under which 
educational institutions might operate. Hence, while the 
accrediting agencies, especially those operating in the general 
fields of education, did not claim the virtue of defining the 
good qualities in education, they could not in most instances 
be accused of breaking the great American tradition of free- 
dom in teaching. 

I have mentioned this historical background in order that 
you may think of the accrediting agencies, first, as a natural 
evolution in American educational history, and, secondly, to 
explain in part why it seemed necessary in the earlier days 
to select such crude methods of evaluation. These crude 
methods have now produced a widespread revolt among edu- 
cators and laymen alike who are demanding that we find other 
and more direct ways of identifying educational effectiveness 
while at the same time preserving intact that liberty of objec- 
tives and quality of instruction that seems to be all but 
instinctive in American character. 

Psychological Factors—There is another explanation of 
our present situation which I believe to be purely psychological. 
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Anyone who has ever attended a faculty meeting, or sat in at 
the sessions of a state legislature, or gazed in awe at the 
operations of one of our accrediting agencies will not have to 
be reminded how instinctive it seems to be for well-intentioned, 
presumably intelligent people to seek some panacea in the 
form of a rule or a law which will reduce to as near zero as 
possible the amount of thought and judgment necessary to the 
solution of each individual problem as it arises. There can 
be no doubt but that rules and laws are extremely important 
vehicles of society but they also represent defenses behind 
which even educators who ought to know better hide cowardly 
until long after their usefulness is past. Hence, I foresee not 
only a present but a long continuing future danger to educa- 
tion of these processes of evaluating higher educational insti- 
tutions through the natural but relatively ineffective definition 
of the conditions under which these institutions may operate. 
The human mind instinctively hopes to attain an abstract 
social goal through a continued process of fiddling with the 
attendant machinery. 

We have so long devoted ourselves to the perfecting of 
external machinery as a means of identifying the respectable 
higher educational institutions as to lead many discerning 
people to fear sincerely that we have created a Frankenstein 
for ourselves. I do not think so, although I must admit that 
I can see the embryo of such a monster. I am certain, how- 
ever, that before breath is given to his nostrils or blood to 
his veins American educators will either slay him or, through 
some more or less violent metamorphosis, change him into a 
good educational workhorse. 

At this point may I digress to comment upon a line of 
discussion which has been interpreted by many people as 
removing all reason for accrediting colleges and schools. I 
refer to the development of the testing and personnel move- 
ments which it is said substitute the accrediting of students 
as individuals for the accrediting of institutions. Such an 
argument seems very intriguing at first but I am convinced 
that conclusions much too far reaching in character have been 
drawn from the studies which have been made. 
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Recent years have seen a tremendous advance in devising 
scientific measures for testing the native ability and the 
achievement of individual students. All of us rejoice at the 
progress which has been made in this field. We believe that 
the testing movement will gradually enable us to solve many 
of our most difficult problems in counselling, guidance and 
placement. If I err in my attitude toward this new device of 
education it is the same error which many other ardent 
friends of the movement commit, namely, that of placing far 
greater reliance on the results of tests than dispassionate 
judgment probably justifies. I mention this because I do not 
wish my position relative to the value of the testing move- 
ment to be misunderstood. 

The researches of Professor H. H. Remmers in Indiana 
and the group at the State University of lowa, for example, 
are in point. In both of these states through an extensive 
testing program of students enrolled in the secondary schools 
it was demonstrated first that there are marked differences 
between the achievement of students in the various schools 
and that the present methods of accrediting schools did not 
by any means separate out the schools whose pupils on the 
average achieved the most from those which had lower 
averages. Furthermore, even the schools with the lowest 
averages had considerable percentages of students in the 
upper brackets while the best always contain many who do not 
show up well. Hence Professor Remmers concludes: 


“According to the data presented in the foregoing sections, 
neither the Indiana accrediting agency nor the North Central 
Commission is very successful in evaluating high schools. As 
a matter of fact, ‘approval’ by either or both of these agencies 
means little in terms of what the schools under consideration 
really accomplish educationally.” 


It should be admitted at once as I have endeavored to do 
elsewhere in this paper, that the methods used by the accredit- 
ing agencies in evaluating the effectiveness of a school or col- 


2Remmers, H. H. and Trimble, O. C. Measures of Educational Outcome 


Versus Standards of Institutional Machinery as High School Accrediting 
Criteria. Bulletin of Purdue University. Studies in Higher Education 
XXII, p. 34. 
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lege have been crude and unscientific but it does not follow, 
simply because there is a wide difference between two schools 
as to the levels which their students reach respectively on 
achievement tests, that one is a better or a more effective school 
than the other. Any two schools will vary greatly in the 
types of students which they enroll just as any single school 
will contain students with a rather wide range of ability. 
Hence to assume that only those schools or colleges whose 
students make the highest average on tests are the ones which 
should receive recognition is to ignore altogether both the level 
of native ability and of preparation which students possess at 
the time of entrance. A school or a college may enroll stu- 
dents of fairly high ability and good preparation and yet do 
relatively a poor piece of work. On the other hand, a school 
or college enrolling students whose level of native ability 
and preparation may be fairly low and which adapts its 
resources vigorously to a program suited to the needs of its 
students may be in its realm as effective if not more effective 
than the first institution. Until, therefore, we relate the 
results of tests for native ability to the results of achievement 
tests from the same students, until we compare the achieve- 
ment of students at the end of two, three or four years with 
what they started out with, and until we take into account the 
differences in objectives which the respective schools and col- 
leges may be expected to have we have no right to assume 
that a high level of achievement test scores is any better gauge 
of the effectiveness of the school or college than the crude 
methods now being followed by the accrediting agencies as a 
means of identifying the effectiveness or the quality of the 
institution. So far as I know the conclusions which have been 
reached relative to the substitution of the accrediting of indivi- 
duals for the accrediting of institutions have not been based on 
considerations of this kind. 

When that stage of development is reached in the testing 
program the results of tests may become a significant means 
of identifying the quality and the effectiveness of the educa- 
tional process at a given school or college in comparison with 
what is found through the same process at another school or 
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college. To whatever extent therefore that tests can be used 
in the process of accrediting schools and colleges, I am sure 
that they will be welcomed as one of the few objective and 
scientific means of evaluating an institution that we now have 
at our disposal. 

On the other hand, not even the most ardent friend of the 
testing movement would claim that the results of tests measure 
all that we expect our youth to get out of school or college. 
An English schoolmaster recently said that he believed that 
the education which a school boy receives out of class was 
more significant than what he secures in the classroom. 
Whether we agree with him or not we must agree that tests 
do not measure this aspect of the educational process very 
well, if at all. 

In the same way the results of tests do not measure all that 
we expect a school or a college to be. Fond fathers and 
mothers, for example, want to know whether the social life 
of the school or college is healthful; the people of a com- 
munity want to know whether their schools have adequate 
equipment to do the things they attempt to do; the constitu- 
ency of a school or college wants to know whether the finances 
are being handled properly; in short, society, as I endeavored 
to say at the beginning of this address, is interested in the 
total pattern of an educational institution including that part 
of the educational process which can be measured objectively, 
that part which is imponderable, and even that administrative 
and physical machinery and equipment commonly regarded as 
necessary or desirable for an effective school or college. 

I trust, therefore, that you will join me in regarding the 
accrediting of students through the testing and personnel 
movements not as a substitute for the accrediting of schools 
and colleges but as a supplement to it. Both are extremely 
valuable and important social devices operating for essentially 
different though supplementary purposes. While the accredit- 
ing of individuals may modify the methods of accrediting 
institutions and even be used as an important means to that 
end, it will never be more than one of those means. Society 
is anxious for the new ways of identifying the native ability, 
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the special interests and the achievement of individuals, but 
it is equally interested in ways and means of identifying the 
total effectiveness and the adequacy of the institutions which 
it establishes for these and other purposes incidental thereto. 

If, now, we have passed the time when we ought any 
longer to depend upon standards which define the conditions 
under which a school or a college should operate as the best 
and most practicable method of identifying the quality of an 
educational institution, how then shall we proceed to do so? 
This is the problem which has faced the North Central Asso- 
ciation in its attempt to revise its system of accrediting higher 
institutions. In order that a thorough study of this situation 
might be made the Association secured an appropriation of 
$110,000 from the General Education Board to supplement a 
fund of $25,000 which the Association itself is putting into the 
study. It is expected that the study will be completed at the 
end of the current academic year. 

As yet we have no right to reach any but the most tentative 
conclusions. There is, however, one conclusion which, unless 
the evidence fails to justify it, has been rather widely accepted; 
and that is that the standards of the future will be general in 
character. This probability and the implications connected 
with it, together with certain other considerations, have in- 
duced me to attempt to set forth some of the main issues 
which will have to be decided before we enter a new era in 
the work of accrediting schools and colleges. 

In order to introduce the subject, may I mention a possible 
standard on admissions for colleges and universities, “An 
institution should have a system of admitting students who 
are competent to undertake the work of the curricula to which 
they are admitted.” 

You will notice that in this definition nothing is said about 
high school units nor accredited secondary schools. In other 
standards I believe that it will also be possible to omit all 
specific requirements relative, for example, to 120 semester 
hours for degrees, minimum endowment and income pro- 
visions, the requirement for a minimum of eight departments 
and 8,000 books in the library, sixteen hours of teaching, and 
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the specification relative to Doctor’s, Master’s and Bachelor’s 
degrees for faculty members. Even the word “standard” 
itself may enter the limbo of obsolete terms. If it remains, 
it will put off all of the old meaning of minimum specific 
requirements and take on the new meaning of a desirable 
ideal or principle toward the more complete attainment of 
which all institutions, even the best among the accredited 
ones, may strive continually. Minimum specific standards of 
the old type may always be realized rather easily by institu- 
tions with fairly good financial resources. Standards of the 
new type, like all ideals, are never completely realized by any 
institution; but they stand as a constant challenge for im- 
proved effort to all institutions. 

In substituting general optimum standards for minimum 
specific standards, it is at once clear that there is no one royal 
way to realize the ideal set forth in the standard. In every 
case there is likely to be a variety of ways. Hence an insti- 
tution will be fully at liberty to choose its own methods. In 
some instances the institutional machinery may be elaborate 
and formal; in other instances it may be possible for an insti- 
tution to perform the function as effectively through machinery 
which is less imposing and much more informal. 

If very full liberty as to ways and means of attaining a 
standard is extended, an institution may reasonably be expected 
to accept appropriate and accompanying responsibility. An 
institution should, therefore, in the process of accrediting, be 
able to demonstrate that its methods, its plan, or its organi- 
zation are well considered and that they are effective in attain- 
ing the general principles called for in the standard, as they 
apply to the objectives which the institution has set for its 
goal. For example, to take an extreme case, I presume that 
anyone in visiting an institution would have real cause to 
question the practice of allowing engineering students to enter 
with no mathematics. Yet it is imaginable that even in an 
extreme case of this character, the institution has worked out 
well planned procedures for taking care of this situation. If 
it has done so, it will certainly be superior to the old minimum 
standard which simply requires fifteen so-called high school 
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units. The results of the procedures, not the procedures 
themselves, will be the test of the degree to which a standard 
is attained. 

We cannot write standards in general terms and permit 
full liberty in methods of attaining them without at once lay- 
ing ourselves open to a charge that the standards are so vague 
that they lack meaning. There will be annual demands for 
amendments. The officers of the accrediting agencies will be 
challenged constantly to interpret them so that institutions 
which are applying for accrediting and others whose status 
may be called into question may know “what to count on.” 
After all, one of the reasons why we have our present type 
of specific standard relative to educational machinery is that 
the human mind, including that of college presidents and 
school principals, constantly attempts to express abstract quali- 
ties in concrete terms. We are forever engaged in the futile 
business of trying to solve all our problems in faculty meetings 
and in Congress by passing some specific rule which will do 
away with the necessity of considering a particular situation 
on its merits. 

In this discussion I wish merely to make it plain beyond 
question that, if we wish to replace our present wooden 
standards with general optimum standards and the accompany- 
ing liberty of procedure to attain them, we cannot, at the 
same time, expect to satisfy the natural desire for definiteness. 
As the old proverb well says, ““We cannot eat our cake and 
have it too.”” Even, therefore, if general standards are in- 
evitably accompanied with some disadvantages in the sense 
that they lack definiteness, we shall simply have to accept this 
situation as a part of the bargain with the full resolve that 
we will at least give them a full trial. I see no other 
alternative. 

With the adoption of new standards we must also estab- 
lish accrediting procedures that are more scientific and much 
more carefully carried out. While some improvements have 
been made in our procedures in recent years, our methods of 
evaluating an institution are essentially the same as they 
were twenty years ago. In short, we have not taken advantage 
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to any considerable extent in our accrediting procedures of 
the newer, more scientific methods of evaluating an institution 
which have been developed during the last twenty years. At 
any rate we can all agree that there is great room for improve- 
ment and that under the general type of standards such im- 
provement in procedures is all the more necessary. 

I have discussed briefly the relation of testing individual 
students to future accrediting of schools and colleges. The 
testing movement may prove very helpful but I wish now to 
hazard the guess that the accrediting associations should not 
themselves engage in a comprehensive testing program in insti- 
tutions which are applying for accrediting. They may, how- 
ever, properly expect an institution to show that it has an 
active testing program and to make the results available. 
Information along these lines becomes an important part of 
the total information available about each school or college. 
Indeed, the greatest need in connection with improved accred- 
iting procedures is accurate and comprehensive information 
about an institution. There must be a schedule of informa- 
tion from each institution that is much more elaborate and 
more searching than that which so far has been called for. 

Next, I am confident that the one-man, one-day inspection 
should be abandoned, and that in the place of so haphazard a 
method at least two individuals, perhaps three, should visit 
each institution and that they should stay at least two days. 
I would have such a committee of two or three visit from six 
to twelve institutions each year. If possible, I would have 
some continuity as well as some change in these inspectors 
from year to year. The inspectors should secure the types 
of information which in their nature are not readily obtain- 
able by questionnaire. On the basis of all available sources, 
objective tests, objective information as to institutional pro- 
cesses and characteristics, and the imponderable impressions 
gained by seeing the institution at work, the inspectors should 
be able to render a very dependable report. These reports will 
be based on much more adequate information and much more 
dependable impressions secured by at least two persons who 
can compare conditions at a number of institutions. If some 
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such plan as this were established, I believe the quality of the 
inspection process would be immensely improved. 

My purpose in this discussion of procedure in accrediting 
is to emphasize as strongly as I can the necessity for placing 
the whole process on a much higher plane than it is at present. 
If accrediting is worth doing at all, let us do it on the basis of 
the best and most complete information that we can get; let 
us secure each year a limited number of persons of recognized 
standing to interpret the data, make the inspections, and 
render reports on a comparable basis. Who can doubt that 
if this is done, accrediting will be elevated to an entirely new 
plane in the estimation of the institutions themselves and of 
the general public? Moreover, I have always contended and 
I believe now that if we improve the accrediting process, 
including the inspections, in some such manner as I have 
described, it will convince people that it is equally important, 
if not more important, to emphasize quality in accrediting 
procedures as it is to do so in the standards themselves. 

Standards of general character will be as valuable for pur- 
poses of stimulation to institutions already accredited as to 
those which are newly applying. As a matter of fact, they will 
probably be written more with these institutions in mind than 
for those newly applying. The old standards were minimum 
standards not in any. way intended to portray ideal conditions. 
One of the sad things about past and present conditions is 
the fact that they have often been regarded by people as a 
sufficient and adequate ideal to be attained. We have had 
nothing in our basic principles or in our procedure to gainsay 
this impression. The new standards will be ideals toward 
the attainment of which the institution seeking accrediting and 
the one which has long enjoyed that status may work with 
equal zeal. 

GeorcE F. Zook, 
U.S. Office of Education. 
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The Administrator and the Testing 
Program’ 
INTRODUCTION BY DEAN HERBERT E. HAWKES 


It was a very great pleasure yesterday morning to welcome 
you to the first meeting of this conference, and I hope you have 
enjoyed the meetings between the meeting of yesterday morn- 
ing and this one. It is also a pleasure to be here this evening 
with you, and to welcome our guest of this evening to this 
climax of the program. 

I think it is a very good thing for us to get together once in 
a while and to address ourselves to the difficult task that is 
before us, for this conference marks another stage in the 
career of the Educational Records Bureau, the Cooperative 
Test Service, and the Progressive Education Association, all 
of which are responsible for the conference. 

I suppose that we would all agree that our central problem 
is that of knowing and providing wisely for the needs of 
each individual in our schools and colleges. To say this is 
very easy. To do it even for one single individual is not easy. 
It is very hard. 

I wonder why this task of learning the individual is so diff- 
cult. Why has it been so difficult for us to develop even the 
imperfect techniques that we have? Well, if it had been an 
easy or simple task, it would have been settled ages ago. In 
the natural and physical sciences it is the individual that is 
hard to learn. 

Only recently has any one known or even suspected how 
complicated the individual in physical science—namely, the 
atom—really is. When I was studying physics the atom was 
a little hard ball; at least that is the impression that it made 
upon me. At any rate, it was so simple that nothing could 
be simpler. But now the one thing that cannot be understood 
or predicted in physics is the way in which the erratic little 


Presented at the Third Annual Meeting of Institutional Members of the 
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electrons shoot to and fro around the nucleus. Instead of 
being simple in its nature, the individual in physics is complex 
beyond all imagination. 

When one deals with masses as the older physics did, it is 
comparatively simple to discover their laws of operation and 
relation. ‘These masses which are made up of millions of 
temperamental little atoms follow fairly fixed laws. When 
one gets a sufficient number of unpredictable atoms in a mass 
their eccentricities smooth out under some kind of a law of 
averages and the mass seems to obey a law of heat or gravita- 
tion or optics. But in the development of science it was the 
study of masses that preceded by many centuries the knowledge 
of the individual atom. 

In the study and measurement of personality, are we not 
facing something like the same situation? In the discussions 
of this conference we are trying to treat the problems of the 
individual. I do not know which is the more unpredictable 
and erratic, the individual atom with its shooting electrons 
and its central nucleus, or the individual temperament of the 
human being. In many young persons I can recognize some- 
thing analogous to the darting electron, but sometimes find a 
little difficulty in detecting any nucleus or stabilizer for the 
individual. At any rate, I know that we are taking hold of a 
problem of such difficulty that we can hardly hope for more 
than a glimmer of light upon it. I cannot say that the laws 
governing masses of individuals—the nations and races of the 
world—are developed with the same clearness that is found 
in the case of some of the laws of physics. However that 
may be, I am certain that our difficulties are great. 

The effect of a reflection like this should not cause one to 
give up. Quite the contrary. We should redouble our efforts 
to understand the nature of human character and tempera- 
ment and to evaluate the result of human endeavor. [If it is 
difficult, so much the greater reward and satisfaction for 
the little progress that we have made. If it is complex, 
more patience and tolerance is necessary on the part of 
everyone for the gropings of those of us who are trying 
to work in the direction of the dim light that is revealed to us. 
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Never for a moment can we afford to lose sight of the funda- 
mental and everlasting importance of the individual human 
spirit and the solemn obligation that rests on each of us to try 
to understand and to measure progress both in mind and in 
character. Those of us in this room, perhaps more than most 
teachers and administrators, know the shortcomings as well 
as the values of the efforts that organizations like the Educa- 
tional Records Bureau have been making for the past few 
years. It is easy for the unthinking critic to point out the inade- 
quacy of our work. But what is the substitute for it? It is easy 
to lie down inert as if dead. In such a state one returns to 
the dust from which he sprung with a minimum of agitation 
or trouble. But it is baffling to live and to understand life. 
It is supremely important and interesting to try to do it. 
That is what the Educational Records Bureau and all of the 
agencies that are attacking this problem of the individual are 
attempting to do. And in that direction lies the hope of our 
profession and of the education of the future. 


ADDRESS BY PRESIDENT CHASE 


HAVE been somewhat puzzled to find a title for this ad- 

dress. I am not competent to talk to you tonight about 

the details of testing programs and policies. I have, how- 
ever, followed the enlarging scope of objective testing pro- 
grams with a great deal of interest and growing confidence. 
I thought, therefore, that perhaps I would try to give you 
some of the impressions of an administrator in the field of 
higher education as he finds himself brought face to face with 
this developing movement in education. 

Examinations are as old as the human race. It is easily 
possible to imagine that the Stone Age man, when he had 
reared his young to the point where they were filled with a 
proper amount of tribal knowledge, insisted on their answer- 
ing any ten of twelve questions, and graded their replies as 
worth ten points each, if indeed he could count so high. Any- 
how, from that day to this, examinations have been an integral 
part of the process of education. Institutions of all nations 
have specialized in various refinements of such torture, 
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developing new instruments with something of the loving care 
of a mediaeval execution. To most of us those frightful hours 
that we spent in session with men who examined us for the 
doctorate will always remain a fresh and vivid memory. I, 
personally, have always had great sympathy with the college 
president who waked up one night from the awful nightmare 
that he was being compelled to pass the entrance examinations 
to his own institution. As a teacher, I have done my share 
to contribute through examinations to the termination of col- 
lege careers on the one hand, and to Phi Beta Kappa on the 
other. I have listened to endless debates as to how often 
examinations ought to occur and how long they ought to be 
and who ought to be given a second chance. As an adminis- 
trator, | have known many kinds of examiners. I have known 
instructors who frankly used examinations as means of prov- 
ing to students that their subject was too difficult for any 
but the highly exceptional mind to comprehend. I have known 
others who with equal frankness used examinations as means 
of rescuing the perishing who otherwise might have flunked 
the course and interfered with the popularity of the teacher. 
I have sometimes speculated on the influence of such factors 
as indigestion, domestic quarrels, late parties and first of the 
month bills on examination grades. I have seen something of 
what happens when the same paper is given to a number of 
different people to grade. I have seen all types of examina- 
tions. I have known of fraternity houses that stocked up on 
examination papers for ten years past, and I have understood 
that sometimes they have found that examinations recurred in 
cycles like depressions. I knew a teacher, who, year after 
year, gave the same examination, which consisted of one ques- 
tion, namely: Trace the development of this course as outlined 
in the lectures. 

I have known plenty of students whose knowledge of a 
course was born the night before the examination and died a 
painless death the next afternoon. In short, I suppose that 
my experience has been typical of those who have watched 
this process with some interest. This business of examinations, 
then, is something to which the human race is prone. One 
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must suppose that it grows out of some very deep-seated need 
in human nature. In the days when people believed in in- 
stincts, 1 suppose that we would have said that it was an 
examining instinct, that the situation consisted of a more or 
less helpless student nearing the end of a given section of his 
work, and the response was a composition on the part of the 
instructor, of certain puzzles which tended to produce highly 
emotional reactions in the cortex and sympathetic system of 
the sufferer. 

I have been talking, of course, about subjective examinations 
which are set by individuals in terms of a judgment of indi- 
viduals. That is the usual way, I suppose, in which most people 
think about examinations. The instructor in his best judg- 
ment, when a particular date on the calendar arrives, makes 
up a series of questions that in his judgment cover the impor- 
tant points of his work and then he grades the replies accord- 
ing to his best judgment, depending on the scale of values that 
he himself thinks proper, and doing his best to apply these 
impartially. This is what we may call the examination pro- 
cedure in its simplest form. The actual results are subject to 
many conditioning factors. In the first place they are subject 
to the accidents of the student’s mental, physical and emotional 
condition at the time when the process takes place. But these 
factors of variability are even less important than those which 
affect the instructor. He must, in the first place, make his 
examination papers. The institution has a passing grade and 
he must make an examination which will allow a reasonable 
number of students to attain that grade. He must make it 
without any actual knowledge of the relative difficulty of the 
questions which he asks or of the way in which they measure 
what he wants to measure. He is like the physician who starts 
out to examine the patient as would the old country doctor. 
The fact that sometimes an individual of experience and 
shrewdness got highly accurate results by such methods does 
not deter us from recognizing the immense step forward which 
has been taken by modern medicine with the objective equip- 
ment at its disposal. 

In just the same way, teachers of experience and mental 
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balance operate sometimes wonderfully well on the highly 
individual basis which I have been discussing, but at its best 
the old type of examination remains in the region of opinion. 
Countless individual factors on the part of the instructor can 
and do enter in to determine his judgment. Sometimes these 
are not limited to himself. His standing in the department 
or in the institution may be involved. Even public pressure 
may enter as it does in some communities, for example, in 
which it is more or less an accepted theory that any student 
who shows sufficient perseverance to stay in high school ought 
to be allowed to pass sufficient examinations to graduate. 

The difficulties of this situation have of course been recog- 
nized for many years. An attack on the problem in one sector 
was made a generation ago in the attempt to overcome the 
difference between the standards in different schools by state- 
wide examinations in secondary schools and the college board 
examinations for college entrance. Such procedures do away 
with the formulation of examinations by the individual without 
check or control. But the formulation of the examination and 
its evaluation still remain subjective and the decision still turns 
on the condition and status of the individual student at a given 
moment which may or may not fairly reflect his ability. 

While these procedures mark a real advance, one is still deal- 
ing with the attempt to measure important things in terms of 
judgment and opinion. Psychology, like medicine, began a gen- 
eration ago to swing over to the objective technique of measur- 
ing. Apparatus for measuring blood pressure, X-rays, and men- 
tal tests came into the world at about the same time. Both sci- 
ences began to conceive the idea that it was possible to measure 
things which heretofore had been subjects of guess work. 
Twenty-five years ago Binet was popularizing the idea that it 
was possible to measure the age levels of children in terms of 
standard norms, and Thorndike and others in this country were 
developing techniques for measurement of mental traits. The 
war, which brought forward the army tests, gave a great impe- 
tus to the movement in this country, and at the close of the war, 
institutions began to adopt such tests, mostly at first, for 
entering freshmen. Naturally, such single measurements had 
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grave limitations, and some of the hopes pinned on them failed 
to materialize. Interesting and valuable results, however, 
have come from the large and representative group of institu- 
tions which has used these freshman tests over a period of 
years, and the educational value which they have had for col- 
lege faculties and certain sections of the public, has been very 
great. 

I need not rehearse here the work done by the organizations 
that are sponsoring this conference which has grown out of the 
realization that the transfer of our thinking about examina- 
tions from the subjective to the objective status was a problem 
which had to be attacked with great care and infinite labor. 
The growing recognition of the work that is being done by 
these agencies, the slow but steady education of sections of 
public opinion which are involved, are familiar to all of us. 
What I wish to do is, rather, if 1 may, to spend a few minutes 
in an attempt to evaluate from the point of view of an admin- 
istrative officer, the situation which now exists. 

In the first place, the social and the economic situation which 
confronts us is one which is rapidly bringing to the front the 
question of what is to be done with our young people en masse. 
It seems fairly apparent that the years up to maturity are 
ceasing to be productive for industry, and that they must be 
used in any rational system, more and more for education. 
That is the direction in which it seems to me we are headed. 
I cannot conceive that public opinion will be content both to 
exclude young people from work and from school. The result 
will be a series of demands on education at the secondary and 
college level which, in my judgment, are destined to work pro- 
found changes in our traditional conception of education. 

We have been confronted in America with a rather curious 
situation at the secondary and higher levels. For many years 
the public has attempted to establish varied types of educa- 
tional institutions. At the secondary level, it has established 
technical and commercial high schools, and it has developed 
a variety of types of institutions for secondary school grad- 
uates. Normal schools for the training of teachers have a 
long history. Under the impetus of the Morrill Act in the 
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sixties, institutions were established for the training of stu- 
dents in agricultural and mechanic arts which were obviously 
intended to be quite different from colleges and universities. 
We have been very prolific in founding institutions intended to 
meet the needs of students of a wide variety of interests and 
capacities. But the interesting fact is that any of these, once 
they have been established, have yielded to the pressure to 
become educationally orthodox. Technical high schools have 
developed into college preparatory institutions. Normal 
schools have become colleges, and agricultural and mechanical 
colleges have striven to become universities. In other words, 
it has proven exceedingly difficult to break away from the tra- 
ditional existing pattern in secondary and higher education. 
As has been said by others, our American idea seems to 
have been not only that we should give everybody an educa- 
tional opportunity, but that we should give everybody the same 
kind of educational opportunity. Now I do not believe that 
we can much longer continue on such a platform. We must 
attempt to clarify our conceptions. This is a matter of the 
greatest social consequence. One has to recall, I think, that 
the enormous growth of education at secondary and higher 
levels is a very recent phenomenon. Since 1900, there has 
been an increase of 600 per cent in students enrolled in institu- 
tions above the secondary level, and an even larger increase 
in the population of our secondary schools. We have been 
going through a period in which we have been trying desper- 
ately to <-large our facilities in order to deal with this enor- 
mous expansion. We have done this in general along the 
traditional lines. Some colleges and universities have made 
distinct progress in a genuine selection of students. Others 
have talked about it in catalogues and literature but have 
failed to give the Registrar’s office, apparently, the contents 
of such bulletins. On the one hand, we find a group of people 
who insist that too many students are going to college. I 
think this is too simple a statement of the problem. If we 
consider the matter in terms of the traditional college curricula 
and programs, we will all agree, I am sure, that there are 
many students in our colleges and universities who should not 
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be there, for such facts as are being assembled seem to indicate 
that there are probably an equal number of high school grad- 
uates who are not in our colleges and universities who could 
profit by attendance at them. There are many misfits; there 
is much human waste. These things are obvious to us all. 

I am not wedded to the existing type of college curricula. 
I think we are not doing anything like as good a job as we 
could with our present knowledge and resources. There must 
be definite reconstruction but there must be more. There must 
be genuine differentiation in terms of the abilities and capaci- 
ties and interests of students. We need to think less about 
educational orthodoxy and more about this great social prob- 
lem of constructive work for the needs of adolescents of widely 
varied types of background and ability. This is one side of 
the problem. We need a system in secondary and higher edu- 
cation to deal in terms of the great task which will increas- 
ingly confront it. The other side of the problem has to do 
with the means of insuring that the individual finds his proper 
place in such a system. I mean that he must be so located 
that he will be doing the kind of thing that he is fitted to do. 
In this respect judgments are customarily made on the basis 
of unchecked opinion. In the days when I was a dean, I 
remember that a boy’s mother came to see me one day because 
her son was in trouble as a freshman in the engineering school. 
It was not a matter of much difficulty to find out that his 
trouble came out of the fact that his ability in mathematics 
was extremely low. This interested me and I asked her how 
it was that with that make-up he had decided to enter an engi- 
neering school. ‘Well,’ she replied, “a year ago we were 
having our house wired for electricity and John was immensely 
interested in what the workmen were doing, so we thought he 
probably would make a good electrical engineer.” 

That is just about as intelligent as much of the vocational 
guidance which has gone on. We cannot afford to continue 
at that level. What, therefore, can we do? It is for the 
answer to that question that those of us who are concerned 
with administration in our colleges and universities must look 
to the programs which are being developed by these groups 
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of yours. It is in terms of such programs, for example, that 
the University of Minnesota has already set up a Junior Col- 
lege whose students are really selected. May I pause for a 
moment to say that this is a real example of selection. When 
we talk about selecting students, the public ordinarily conceives 
of this process as being a selection of those with the highest 
degree of intellectual ability. This is one misconception that 
it seems to me needs to be corrected. If the public is to be 
enlightened on the meaning of a really selective program, you 
offer us things in which all of us ought to be very much 
interested. 

In the first place you are developing tests which are objective 
in character. In the second place you are shifting our view- 
point away from the idea that a single test or series of tests 
which measures the individual’s status at a given moment is 
in any way conclusive. One gets into curious situations in that 
respect. I remember in one southern state, where a program 
of objective tests for high school seniors had been developed 
in a purely exploratory and advisory way, I was interested 
in the fact that a student of considerable ability who had come 
on to the university and was doing well there, ranked down 
very close to the bottom in the tests which he had taken as a 
high school senior the spring before. I asked him about it one 
day and he said that the tests were given on a day when they 
had the only considerable snowstorm that they had had for 
several years. They knew that nothing depended on the re- 
sults of the tests and there was a snowball fight arranged to 
take place at the earliest possible moment. Under such cir- 
cumstances vocational guidance gets a bit mixed. What you 
are doing, however, and have been doing increasingly, is to 
stress the development and the factor of growth with the 
clear understanding that the value of objective tests is cumu- 
lative and your tests give comparable results. When they are 
given under properly controlled conditions, individual factors 
play no part in their evaluation. One knows something about 
the actual achievement and ability of a student whether he 
comes from New York or Minnesota. 

It was inevitable that ideas like these opposed as they are 
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to long prevailing and traditional practices should meet with 
the resistance due to inertia, skepticism and ignorance. It is 
only a few years ago that in the course of a correspondence, 
I received a letter from the president of a large American 
University, in which he declared offhand that psychological 
tests were bunk. I have no doubt that he and many men of 
his generation still think so. I know that a good many mem- 
bers of college faculties still think so, and yet there are abun- 
dant signs of a widely awakening interest in your program. 

The Cooperative Test Service of the American Council on 
Education has won financial support for a period of years 
from one of the educational foundations. The Committee on 
Educational Testing of the American Council is coordinating 
and promoting large scale testing programs. The Educational 
Records Bureau has developed a membership since 1927 from 
twelve schools to something over two hundred. The Progres- 
sive Education Association is carrying on an experiment that 
we are all watching with great interest. —The College Entrance 
Examination Board is giving objective scholastic aptitude tests. 
Of the larger programs, the study in Pennsylvania is, of course, 
outstanding. Iowa, Minnesota, Wisconsin, Ohio, Indiana and 
Kentucky have all organized state-wide testing programs. 
Other states, like North Carolina, have been carrying on sim- 
pler programs for some years and other states, I understand, 
are rapidly awakening to the situation. It is, I think, most 
heartening and hopeful that the movement should have reached 
such a point at a time when I believe the demands on it must 
rapidly multiply. Conversion comes, to be sure, slowly. One 
is reminded sometimes of a story of that opponent of Galileo 
who was told that the astronomer had discovered through his 
telescope the fact that Jupiter had moons. This was so up- 
setting to the gentleman in question that Galileo asked him 
to look through the telescope and see for himself. He refused, 
you remember, to do that because he said Jupiter had no 
moons and he was sure of that fact and if he saw anything 
through the telescope that looked like moons it would simply 
be an illusion. 

There are many people who still refuse to look through this 
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telescope. I was talking one day with the head of a large 
department in another institution about certain objective tests 
that had been developed in his subject. His answer was that 
he had all those tests in his files and that he had never used 
them because they didn’t look to him as though they would be 
any good. 

I should like to make one suggestion. It seems to me that 
the results now obtained and the general status of the whole 
movement are such that the entire question of objective test- 
ing and its importance should be interpreted to the public with 
a good deal of reiteration and persistence. I have been very 
much interested, for example, in the recent article by Profes- 
sor McConn reprinted from the EDUCATIONAL REcorD for 
October, which brings together a good deal of the material in 
the field in a simple and comprehensive way. I am wondering 
whether other more definite attempts should not be made to 
reach the administrative officers of our colleges and universi- 
ties. For example, I know of no manual that brings together 
in unified fashion brief accounts of the character and results 
of the various objective tests in a way that gets the movement 
as a whole before administrative officers. Such a publication 
may exist. I do not happen to have seen it. Publications in 
technical educational magazines seldom get into the hands of 
most of the group in higher education who are influential in 
formulating faculty opinion and procedures. This is unfor- 
tunate. I would suggest publications in periodicals of a more 
general character and even in the popular magazines in an 
attempt to inform intelligent public opinion more thoroughly. 
It seems to me, one danger which such a program as this has 
to avoid is that its enthusiastic adherents will devote their 
main attention to educating each other, forgetting the great 
problem of public education which is involved. In spite of the 
spread of understanding of this work, my observation is that 
there is still a great deal of ignorance in quarters where there 
should be more information as to its meaning and its results. 

This is, I suspect, as good a point as any on which to close. 
If this speech seems to you to have brought in everything except 
the kitchen stove, I would ask you to remember that I am 
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giving some reactions to your program as an interested out- 
sider who has the temerity to say a good many things about 
matters with which you are far more familiar than he could 
possibly be. I thank you for the patience with which you have 
listened and I am convinced that on your program hang issues 
so important that no legitimate means should be overlooked in 
forwarding its success. 
Harry WoBuRN CHASE, 
New York University. 





Religious Instruction at the University 
of Michigan’ 
A tatirise criticism of the large modern university is 


that it is too large and as a consequence gives too little 

attention to the individual student. A little thought 
reveals the fallacy in the conclusion. An organization, like 
an organism, may be large without being ungainly and inefh- 
cient. While it may thus properly be insisted that bigness in 
an institution is not necessarily accompanied by neglect of the 
individual, it should also be appreciated that with institutions, 
as with individuals, the activities and growth must be balanced 
and coordinated if overgrowth and retarded development of 
parts, and in general a disproportioned, loose-jointed product 
are to be avoided. Furthermore, the unbiased educator should 
be the first to admit that our teachers and administrators have 
not, in recent years, devoted enough attention to the spread 
of instruction in our institutions of higher learning. Stress 
has been placed upon aptitudes to the neglect of spiritual 
growth and unified development. It has not been fully recog- 
nized that the final and net result of the educational process 
should be a well-rounded individual, a person trained to main- 
tain his physical well-being and to grow continuously both 
mentally and spiritually. 

Such an orderly and comprehensive growth process need not 
be inhibited in a large university. In fact, it may receive its 
greatest stimulus in the complex environment provided by our 
largest schools. The required conditions for the fullest 
measure of unified development are opportunities in the form 
of mental food, intellectual exercise, and experience in proper 
proportions. Upon educators must rest the entire burden of 
outlining a coordinated program of instruction in social living 
and much of the task of removing man-made obstacles from 
the path of the student. I propose on this occasion to discuss 


1 Address delivered at the annual meeting of the National Association of State 
Universities, Chicago, November 16, 1933. 
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attempts being made at the University of Michigan to stimu- 
late and guide the spiritual growth of the student and thus to 
assist him to obtain an integrated view of man and his world. 

It will scarcely be disputed that a working philosophy of life, 
to be adequate, must represent the adjustment of the indi- 
vidual to his environment and that, for man, the environment 
is in part a social one. Because of the complexity of the en- 
vironment and the diversity of individuals, no one approach to 
life’s problems is adequate. ‘The individual needs a complex 
equipment in the spheres of science, the humanities, religion, 
psychology, philosophy, and contemporary living to realize a 
full life. Furthermore, to be useful this equipment should be 
integrated into a personal religion. This being true, religion 
may both be derived from and expressed through personal 
trial, observation and practice in communal living, formal 
study of human experience in the religious field, and counsel 
and personal guidance in thinking. These approaches and 
guides to character growth are needed throughout life and are 
particularly necessary in the college years. The plan now 
being matured in the University of Michigan takes advantage 
of all of them. 


INSTRUCTION IN THE PROBLEMS OF COMMUNAL LIVING 


In no area is the college graduate more handicapped by 
lack of experience than in the broad field of human relations. 
If he is a doctor he has had hospital practice. If the law is his 
specialty, he has had opportunities to use his knowledge in a 
practice court. If he is a graduate in dentistry, he has had 
clinical experience. If he is a biologist, chemist, or physicist, 
he is familiar at first hand with laboratory techniques. Of the 
social problems with which every citizen is faced and on which 
he will be required to pass judgment, the recent college grad- 
uate, however, has at best only an academic knowledge unless 
he has been trained to be a specialist in some part of the field. 
As a consequence, the alumnus is often little more inclined than 
anyone else to act upon knowledge and reasoned judgments 
rather than upon his emotions in the field of human relations. 
Training in skills has been developed but there has been a 
failure to provide in our institutions of higher learning prac- 
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tical experience as a basis of coordinated thinking upon life’s 
essential problems. Leaders seem to be slow to realize that 
they can no longer separate science and religion, philosophy 
and living, faith and works. Somehow, for each student, the 
fundamental thought in all fields of human knowledge must be 
drawn together into a unified body, and this thought must be 
enriched with experience, if our colleges and universities are 
to be successful in developing an appreciation, if not the reali- 
zation, of a good life. 

On the theory that experience is as necessary in the growth 
of a well-ordered, practical or social religion as in any human 
activity, the University, a year ago, began a controlled experi- 
ment to determine the feasibility and best methods of provid- 
ing this experience. With the aid of the Earhart Foundation, 
selected groups of students are organized under the general 
direction of Dr. Roderick D. McKenzie, Professor of Soci- 
ology. Supervised by advanced students and instructors, the 
undergraduates have been brought into immediate contact 
with the various problems which arise in communal living, 
and through the medium of seminars have exchanged views 
with their fellows. The results have been so satisfactory that 
the experiment will be extended to include more students and 
a broader array of contacts. The project is not designed to 
train specialists, but to develop community leadership. It is 
limited to no one group of students and theoretically every 
student may, and should, elect the work. Since, however, not 
every student can be seriously interested in the program, and 
facilities are limited, careful selection of those to be accorded 
the privilege of pursuing studies in this field must continue to 
be the most practical plan. It is believed that the project 
gives promise of supplying laboratory training under skilled 
guidance which will go far toward giving the student the first 
hand knowledge of social problems which he has not previously 
had, and thus, to some degree at least, promote better, 
because more intelligent, citizenship. 


FORMAL INSTRUCTION IN RELIGION 


The second desirable facility in the evolution of a personal 
philosophy which I have listed is the opportunity to secure 
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religious instruction. There is a common fallacy extant to 
the effect that the state university gives no formal instruction 
in religion. No institution of higher learning could correctly 
be called a university which did not offer courses contributing 
to a knowledge of religion in the broad meaning of the term. 
Sectarianism, in the sense of exclusive or undue emphasis in 
instruction upon any one body of doctrine, is not permissible, 
but this does not mean that the teaching of religion must be 
deliberately heterodox, irreligious, or nonconformist. The 
University of Michigan is designed to be a liberal, cosmo- 
politan, and comprehensive school. In religion it is pro- 
nothing and anti-nothing, but Catholic and Protestant and 
Jewish and Mohammedan and Buddhist, and every other 
faith with a philosophy worth study and adoption. Such sub- 
jects as the nature of religious experience, the history of re- 
ligions, and the philosophies of religious thinkers, properly 
find a place in a curriculum designed to provide cultural oppor- 
tunities, and it must be insisted that religious thinking like all 
other kinds must be informed. One cannot wisely ignore in 
instruction the fundamental fact that faith is not a substitute 
for but the fruit of knowledge. 

In some schools courses in religion are scattered widely 
among departmental offerings, while in others they are 
grouped into a department or school of religion. Neither 
plan is satisfactory. It is believed at Michigan that the courses 
should be grouped to make them easily available to the stu- 
dent, but that to make them the basis of a separate depart- 
ment is to professionalize a subject which should exist rather 
as a general university offering. It is to be hoped that the 
University can soon print an announcement of courses in the 
essentials of religion open to all students, and that this cur- 


riculum, leading to no degree, can be reasonably expanded in 
the near future. 


THE COUNSELOR IN RELIGIOUS EDUCATION 


As a third facility in character training, there is needed in 
the large universities a counselor in religion—a leader and 
correlator of religious expression. It should be the chief duty 








44 THE EDUCATIONAL RECORD 


of this man to keep himself available to the normal student 
who is seriously concerned with developing a philosophy of 
life. The period of adolescence is one of stress and strain and 
the college years are particularly a period of concentrated 
learning to think for one’s self. It is, therefore, to be ex- 
pected that the serious minded undergraduate will frequently 
find himself in the midst of mental difficulties, bewildered, and 
in need of adjustment. Sometimes he will be willing to seek 
aid from his teachers, but often he will need more time than 
an instructor can give him to work through and feel through 
his period of tension and spiritual growth. 

The need of a counselor in this field is now rather generally 
recognized. In the University of Michigan plan he will be 
given greater responsibilities. It is believed that the Uni- 
versity should assist the churches to coordinate and develop 
religious instruction. The plan of ignoring the local churches 
by creating a university church has obvious disadvantages for 
the student, particularly if it is recognized that after college 
he must usually affiliate himself with some denomination if he 
is to continue his religious training. Similarly, there are seri- 
ous objections to the plan sometimes proposed of controlling 
instruction in this field by bringing into the University the in- 
structors and curricula of the churches. Finally, it has been 
amply proven by experience that without some point of contact 
with the University the educational agencies of the churches 
are largely ineffectual. Based upon these considerations, the 
“Counselor in Religious Education” at Michigan will advise 
students and, in addition, will serve as a liaison officer between 
the University and the churches. He will be expected to assist 
the student in making church contacts, to aid the churches to 
develop curricula which will meet the needs of the students, 
and to integrate his activities with the attempt being made to 
provide practical training for community leadership. 


CONCLUSION 


The program just outlined in no way takes the place of the 
instructor-student relationship so important in forming char- 
acter; nor will it conflict or interfere with classroom instruc- 
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tion. In the several disciplines, we are attempting to develop 
open, critical, and cultural attitudes of mind. The difficulty 
encountered is that, owing to a necessary specialization, there 
is a tendency to emphasize particular approaches to the prob- 
lems of existence. It is often not possible in a course to recog- 
nize fully. that each individual must have his own philosophy, 
that the acquiring of a philosophy is a lifelong process, and 
that education can only be considered well-rounded when it has 
taught the student in his thinking to go beyond analysis, be- 
yond memorizing, beyond conventions, beyond material con- 
siderations, beyond particular disciplines, to synthesis, to crea- 
tive thinking, to an appreciation of human values. Valuable 
and indispensable as it is, the classroom work must be supple- 
mented, for the student must learn to use all the approaches to 
the study and understanding of life afforded by the several 
fields of knowledge, must know the facts of social living, and 
above all must be taught the lesson: “It is the most beautiful 
truth in morals that we have no such thing as a distinct or 
divided interest from our race” (Bulwer). 
ALEXANDER G. RUTHVEN, 
University of Michigan. 








Coordinated Examining and Testing 
Programs’ 
INTRODUCTION BY DEAN HERBERT E. HAWKES 


I would like to call the conference to order. This is the 
second educational conference called by the Educational Rec- 
ords Bureau, the Cooperative Test Service and the Commis- 
sion on the Relations of Schools and Colleges of the Progres- 
sive Education Association. The fact that you are all here 
indicates that there is interest in the kind of thing that we are 
talking about. It seems to me that a conference of this kind 
is in the nature of marking the direction of the movement. I 
don’t say that we are crusaders—it would be embarrassing to 
some of us who were brought up in the conservatism of New 
England to appear in that role—but at the same time I think 
we all recognize that we are taking part in a movement. And 
we all know what that movement is. It seems to me to be in 
the direction of looking at our jobs intelligently, which again, 
it seems to me, is in contrast with certain traditional attitudes 
toward the job of the college and school administrator. What 
we are trying to do, in a word, as you all know, is to get some 
means of finding out what kind of human material we are 
working with, and then devising some means of using or bring- 
ing to bear upon this human material instruments and tools 
that are adapted to that material. If we were engaged in any 
mechanical operation of any kind that would be too silly to 
mention—but it has taken us a long while in education to get 
that very simple position, and as you know there are very many 
agencies through which this movement is being carried for- 
ward. Three of them are represented in the calling of this 
conference. The opening address will be pronounced by Dr. 
Wood, who occupies a somewhat strategic position in regard 
to this whole enterprise. Two of these cooperative bodies 


2Opening Address at the Second Educational Conference on Testing 
Programs, New York, November 2-3, 1933. 
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are the Cooperative Test Service, which was organized three 
years ago, and the Educational Records Bureau. The Co- 
operative Test Service, which has the responsibility and privi- 
lege of making various kinds of new type tests in subject 
matters, grew out of the work of a committee of the American 
Council on Education. I have told this story so many times 
that I am sure I don’t have to repeat it. That committee was 
organized in 1923 and struggled for three years in order to 
find out just where they could take hold of the problem that 
confronted them. As we look at the problem today, it seems 
amazing that it should take as long as that for eight or ten 
men of obvious intelligence to find out how to tackle this 
problem which is now taken as a matter of course. But we 
finally got hold of three or four projects which were carried 
forward and out of one of them has grown the Cooperative 
Test Service, which is doing work many of you are familiar 
with. Dr. Wood is Director of the Cooperative Test Service 
and is now also Director of the Educational Records Bureau. 
In a certain sense the Bureau has been looked upon as the 
service end of the Cooperative Test Service. The Coopera- 
tive Test Service prepares the examinations and to a certain 
extent the Educational Records Bureau sees that the schools 
and colleges come in contact with them. The Bureau has not 
yet grown to anything like the dimensions which its oppor- 
tunities and its philosophy indicate it ought to grow to. 
Whether it will or not depends upon the financial situation. I 
may say under my breath that the whole trouble is that all 
this costs a lot of money, and the question is whether it is in 
the luxury class or whether it isn’t. I am sure that somebody 
in the course of the day will say that now above all other 
times, when money is hard to get, we should use our money 
wisely in the process of finding out whether this or that boy 
or girl can profit by the sort of education we are providing. 

But I must not ramble on, since we have three speakers this 
morning, the first of whom is Dr. Wood, the Director of the 
Bureau and of the Cooperative Test Service. 
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Appress BY Dr. BEN D. Woop 


OFFER sincere thanks to the Board of Directors of the 

Educational Records Bureau for the honor of my appoint- 

ment as Director of the Bureau, and for the oppor- 
tunity it confers upon me to collaborate more closely in an 
enterprise which I have long considered one of the most im- 
portant and promising among current educational efforts. The 
acceptance of this new task would have been much less easy 
if I had not known in advance that those who have brought 
the Bureau to its present status of effective service and great 
promise could be counted upon to continue helping us with 
their usual efficiency and devotion. As I have watched the 
Bureau grow since it was founded in 1927, from a member- 
ship of only a dozen or so schools to its present membership 
of over 200, as I have watched it encounter and overcome 
difficulties large and small, it has become increasingly appar- 
ent to me both that the basic programs and philosophy of 
the Bureau are sound, and that all those whose cooperation 
has brought about this progress deserve our congratulations 
and grateful thanks. 

Among the institutions that made possible the founding 
and continuation of the Bureau, the first to be named must be 
the Keith Fund. The trustees of the Keith Fund not only 
made several grants of funds, but have given generously of 
their counsel and wisdom throughout the life of the Bureau. 
Particular thanks are due also to the Carnegie Foundation, 
whose Division of Educational Enquiry has made such large 
and essential contributions as to defy brief mention, and to 
the Carnegie Corporation, whose help at a crucial time saved 
the day. No account of our indebtedness could be remotely 
adequate which did not include mention of the American 
Council Committee on Personnel Methods, whose indefatig- 
able and large-visioned chairman has been Chairman of the 
Board of the Educational Records Bureau for the last three 
years, and also chairman of an increasing number of related 
projects. It is no more than reciting an historical fact to say 
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that the survival of the Bureau during these last three years on 
a self-supporting basis is largely due to the wisdom and devo- 
tion of the Chairman and members of the Board of Directors, 
and to the generosity of Columbia University in furnishing 
quarters. 

Nor could any acknowledgment be complete without men- 
tion of the headquarters staff of the Bureau, which, starting 
with a small and crudely equipped office in 1927, has built up 
an organization which has demonstrated its capacity to handle 
with a high degree of accuracy and speed the scoring and 
reporting of hundreds of thousands of tests each year, with all 
the correspondence, the advisory and interpretive work im- 
plied by such testing service. 

It is a pleasure to me to offer thanks and congratulations 
to each and all of the institutions, groups, and individuals thus 
far named, because it is what they have done and will con- 
tinue to do that constitutes the foundation of my hope for 
meeting with some measure of success the responsibility which 
the Board has thrust upon me. But there is another group of 
institutions whose cooperation in the past deserves our unmeas- 
ured thanks, and whose cooperation in the future will be 
the measure of the final success of the Educational Records 
Bureau and of related projects. I refer to the schools that 
have, year after year, in the face of the greatest difficulties 
and stringencies, participated in the testing and guidance pro- 
grams and activities of the Bureau. It is obvious that, with- 
out their intelligent cooperation, all else would have gone for 
naught; and without their continued active support the admi- 
rable results thus far achieved, with their promise of far 
greater and more enduring gains in the immediate future, will 
be largely dissipated. 

The great majority of the schools whose active coopera- 
tion has made possible the progress thus far achieved by the 
Bureau have been and are the independent schools, the enlist- 
ment of whose interest was due, in great part, to the vigor- 
Ous initiative and abundant enthusiasm of Mr. Charles K. 
Taylor, the first Director of the Bureau. In this work the 
independent schools have added another notable chapter to 
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their already enviable record for initiative in formulating, 
trying out, and adapting fruitful innovations, in inaugurating 
sound reforms, and in lessening the burdens and mistakes inci- 
dent to transitional periods for other schools that follow in the 
progressive path they have blazed. 

While the main burden of the Bureau’s program has been 
carried thus far by the independent schools, the public schools 
that have been actively cooperating have made notable contri- 
butions to the project in spite of the lesser flexibility of bud- 
gets, curricula, and procedures that has thus far characterized 
publicly supported institutions. Perhaps the greatest contri- 
bution of these few public schools is the concrete demonstration 
they have provided that tax-supported budgets are not so in- 
flexible as to restrict their attack on the basic problem of 
guidance to fruitless gestures and pious declamations. The 
pioneer example provided by the public schools of Providence, 
and the more recent innovations in the public schools of Tulsa, 
Oklahoma, which have followed closely the models set up by 
Providence, by the Pennsylvania Study Enquiry schools, and 
by the Educational Records Bureau schools, are being watched 
and studied by a rapidly increasing number of public schools 
and public school systems all over the country. The statewide 
high school-college programs in Iowa, Minnesota, Wisconsin, 
Indiana, Ohio, Kentucky, Colorado, Alabama, Georgia, Mis- 
sissippi, and North Carolina, and the rapidly maturing plans 
in a dozen other states, are encouraging beyond anything the 
most optimistic dreamed of even as recently as five years ago. 
The most extensive and inclusive of the statewide projects is 
the Iowa program, and the most significant and encouraging 
thing about that program from the viewpoint of the Educa- 
tional Records Bureau is the fact that plans are under way 
now for making the cumulative record an integral part of 
that program in essentially the manner advocated by the Edu- 
cational Records Bureau. 

That the colleges are also alive to the basic importance of 
guidance, and to the principle that constructive guidance ulti- 
mately depends on accurate and comparable measures of indi- 
vidual growth in capacity, achievement, and interests, is amply 





OE = 


COORDINATED EXAMINING AND TESTING PROGRAMS 51 


indicated by the studies of the Educational Records Bureau 
and Progressive Education Association commissions on sec- 
ondary school and college relations, by the studies of the 
Committee on Educational Testing of the American Council 
on Education, by the history of the North Central Association, 
and by the aggressive, recent actions of the college associations 
and of individual colleges in such states as Minnesota, Wis- 
consin, lowa, Kentucky, Colorado, and Wyoming, and the con- 
templated actions of college associations in New Mexico, 
Texas, Georgia, Washington, and several others. 

There is more than ample reason for optimism when we 
see independent schools, public schools, and colleges all over 
the country working together in an increasingly harmonious 
and widespread cooperation on a basic educational problem 
which is inherently a problem of coordination and cooperation. 
In a more immediate sense, it is equally encouraging and 
gratifying to note cooperative tendencies among the several 
agencies and organizations that have thus far carried the 
burden of coordinated examining and testing programs. While 
there are still differences to be reconciled, both between and 
within examining agencies, they are largely differences of 
emphasis and of detail. With the growing realization on all 
sides that the welfare of the growing individual in a changing 
society defines the common interest of all agencies and indi- 
viduals in educational work, and with the sobering realiza- 
tion that even with the utmost cooperation there will still be 
dificult problems of technique, of organization, of procedure, 
in suficient numbers to challenge the best efforts and wisdom 
of all who work in the field of personnel and guidance, it seems 
reasonable to hope that effective coordination among examin- 
ing agencies will be realized in the not distant future. 

The two fundamental questions that confront us are, first, 
the purpose of examinations, and, second, how to use them to 
serve that purpose most effectively. Our philosophy of exam- 
inations and methods of using them have been and, so far as 
practice is concerned, are still dragging far behind the technical 
developments in the construction and scoring of tests, and in 
the interpretation of their results. In developing the Scholas- 
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tic Aptitude tests, the College Entrance Examination Board 
has made one of the most outstanding contributions of the 
decade. The more definite meaning of the Scholastic Aptitude 
test scores and the comparability of their measures year after 
year are already recognized as an important milepost in tech- 
nical development. In the older field of subjective achieve- 
ment examinations, the College Entrance Examination Board 
for several decades, and the Secondary Education Board since 
its more recent organization, have exploited the unique poten- 
tialities of such examinations with a degree of carefulness that 
approximates perfection, as far as perfection is humanly pos- 
sible, and with a degree of success that is nothing short of 
remarkable. Recently the College Entrance Examination 
Board has inaugurated some even more promising technical 
improvements which may turn out to be as epochal in ultimate 
influence on education as the original organization of the Col- 
lege Board. 

In the field of objective achievement tests great progress has 
been made, largely by a fusion of the recent technical develop- 
ments in the details of test construction made at the univer- 
sities of Iowa, Wisconsin, Minnesota, and Ohio. The Co- 
operative Test Service, under the leadership of the American 
Council on Education Committee on Personnel Methods, 
with the collaboration of the Educational Records Bureau, 
the Pennsylvania Study of the Carnegie Foundation, and 
many schools and colleges, and with the aid of a ten-year sub- 
vention from the General Education Board, is well on the 
way toward supplying one series of achievement tests in the 
basic subject matters of junior college and high school levels 
that will yield measures which are comparable from year to 
year, and which thus make possible the study of growth in the 
functions measured by the tests. 

While practice still lags far behind these technical develop- 
ments, and the philosophy of examining implied by them, it is 
gratifying to note a much clearer and a much more widespread 
understanding of a constructive philosophy of educational 
measurement, and a rapidly increasing disposition all over the 
country in all kinds of schools and colleges to make these 
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technical advances serve constructive educational purposes 
throughout the whole educational ladder. 

The purpose of examining is not to enforce arbitrary cur- 
ricular prescriptions regardless of the interests and needs of 
individual students; it is not to impose arbitrary or uniform 
standards on heterogeneous masses of students regardless of 
their capacities and ultimate places of service in society; it is 
not to create by authority, coercion, teaching magic, or ritual- 
istic servitude, intelligence, reasoning powers, and creative 
forces in contravention of the manifest will of Providence. 
The primary and basic purpose of examining is to help the 
schools ascertain in meaningful terms the achievements, effec- 
tive interests, and capacities of individual pupils in order that 
the schools may more surely lead them to their most effective 
self-realization in the life which they are to live. More 
briefly, the purpose is to help schools find and meet the needs 
of individuals in a complex and changing society. 

The method by which examinations and tests can serve this 
purpose most effectively is essentially the method which has 
been so clearly demonstrated in actual practice by the Carnegie 
Foundation in the Pennsylvania Study, by many member 
schools of the Educational Records Bureau, by the public 
schools of Providence, and a few other cities—a method 
which has been advocated by the American Council Commit- 
tee on Personnel Methods for nearlfa decade, and which 
accounts for the organization of both the Cooperative Test 
Service and the Educational Records Bureau. This method 
has been identified by its central and unifying instrumentality, 
the cumulative record of measures and observations recorded 
in comparable terms in a form convenient for rapid, accurate, 
and comprehensive interpretation of growth trends, which is 
to be used carefully and continuously if not prayerfully by all 
who take the responsibility of advising pupils. 

There are three features of the cumulative record worthy of 
mention here. The first is the physical form of the record, 
which is arranged in calendar unit columns that facilitate the 
detection and interpretation of trends in particular lines of 
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development, and also display cross sections of the individual’s 
whole recorded status at any one time. 

The second and far more important feature of the Amer- 
ican Council cumulative record is the emphatic plea which it 
makes for the use of measures which are sufficiently com- 
parable from year to year to give reliable and meaningful 
indications of the extent and rate of the individual’s growth 
in each of the functions tested or observed. Since education is 
essentially growth, no record can be called educational which 
does not throw some light on the character and extent of the 
pupil’s growth in intellect, in important types of achievement 
and interest, and in personal traits. 

The third feature is the great emphasis which the American 
Council record puts upon the study of the interests and per- 
sonal development of the individual. The record form pro- 
vides spaces for objective measures of interests and personality 
traits, such as those yielded by the Strong and Bernreuter 
tests for high school and college students; but it provides 
much more space for records of concrete evidence of interests 
and personal developments, and of teachers’ judgments, 
regarding the attitudes and intellectual habits of pupils. With 
the improvement in personal rating scales suggested by the 
American Council Committee and other committees, and 
recently achieved to a considerable extent by the Progressive 
Education Association Committee on Records and Reports, 
this feature of the American Council cumulative record, and 
its now numerous revisions and adaptations, will assume even 
greater importance. 

While all three of these features are important, since the 
first is a great deal more than a mere mechanical convenience, 
the last two represent the gist of the method. We have had 
cumulative records for many years, but by and large they have 
contained little or nothing beyond the subjective and highly 
individualistic judgments of teachers expressed in the ambig- 
uous terms of letter grades or percentages. Such informa- 
tion as they have contained has been so ill-defined and so lack- 
ing in comparability as to be of little use in the long-term 
educational guidance of pupils. 
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The Educational Records Bureau and the Cooperative Test 
Service are dedicated to the task of making it possible and 
convenient for schools to secure information that is significant 
and which can be recorded in terms that are meaningful and 
comparable year after year—the Cooperative Test Service by 
providing comparable tests, and the Educational Records 
Bureau by providing coordinating and interpretive service. 
In this work both organizations have enjoyed the cooperation 
of many schools, colleges, and other examining agencies. Most 
of what success we have enjoyed has been made possible by 
that cooperation, and by the resulting coordination of efforts 
of many workers. 

Thus, while many and difficult problems lie immediately 
ahead, the gratifying progress already achieved and the 
promise of greater gains in the immediate future, and my con- 
fidence in the continued cooperation of all those who have 
brought about the present promising outlook, encourage me 
to accept with high hope the honor which you have seen fit 
to confer upon me in asking me to coordinate the activities 
of two of the agencies that are working in the field of examin- 
ing. While attempting to coordinate the efforts of these two 
organizations, it shall be my constant care, under the guidance 
of the Board of Directors, to seize every opportunity to cooper- 
ate with other examining agencies to the limit of our resources 
in consolidating the gains already made, and in attacking con- 
structively the difficult problems that lie immediately ahead. 

Ben D. Woop, 
Columbia University. 
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INTRODUCTION BY DEAN HERBERT E. HAWKES 


The third paper this morning is by another master in his 
field, whose experience and whose original work has placed him 
in a position to speak with authority on the question to which 
he addresses himself. I take very great pleasure and satisfac- 
tion in presenting to this group Dr. Carl C. Brigham of Prince- 
ton University, Associate Secretary of the College Entrance 
Examination Board. 


ADDRESS BY PROFESSOR BRIGHAM 


HEN the invitation to address this meeting on the 

subject of the new admissions plan at Princeton and 

the prediction of college success was extended, I gladly 
accepted because it gave an opportunity to write a sequel to 
Doctor Learned’s paper on “Admission to College” read here 
a year ago. But, instead of adhering to the double-barreled 
topic assigned, I have tried to discuss the specific Princeton 
scheme and its uses of predictive devices under the more gen- 
eralized formula of “Units and Placement.” 

“Prediction” is a term which implies a high degree of cer- 
tainty. Its use in educational discussions resulted naturally 
from the methods of correlation adopted as instruments of 
study. But, as everyone knows, all correlations which have 
ever been found between examinations and college standing 
are too low to give any feeling of certainty. The low corre- 
lations obtained from single tests and examinations led people 
to try to combine the results of several kinds of evidence into 
a single index by the use of multiple correlation methods. 
The Princeton “bogie” and the Yale “predicted grade” are 
typical of such combinations. These indices correlate about 
.65 or .70 with college standing, and thus provide usable bet- 
ting systems, but not exact prediction. 


*Presented at the Second Joint Educational Conference, New York City, 
November 2, 1933. 
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The Princeton bogie and the Yale predicted grade are gen- 
eral indices. They add in everything that seems significant. 
Lately, people have been trying to find more specialized in- 
dices for use in the assignment of students to certain college 
courses, French, mathematics, and so on. In this problem of 
special assignment the single devices are weaker and the 
methods of investigation break down because of the unreli- 
ability of college marks and, further, because of the inade- 
quacy of college courses. I think that everybody who has 
worked in this field is becoming tired of assuming that the 
criterion—the college—is infallible and that the sources of 
evidence derived from the school and the examinations are 
in error. In many subjects of instruction the methods of 
teaching and examining in the college are so faulty that a 
perfect instrument of prediction could not correlate higher 
than .40 or .50 with the college result. The immediate situa- 
tion demands, however, not a perfected technique but merely 
an intelligent betting system. Such a betting system is at hand 
when an intelligent individual accumulates all the evidence 
available concerning the student and assigns him to a certain 
college course. Under the present conditions it is better to 
go ahead with such placement than to await the millennium 
of a perfect educational scheme and perfect measuring devices. 
The theory underlying the new scheme of admissions to Prince- 
ton assumes that such discretionary placement is possible now. 

Any person who has tinkered with admissions requirements 
to colleges soon senses a difficulty in the notion of a unit. Our 
notions of the curriculum and our notions of the usability of 
measurement are changing, but the concept of the unit is 
fixed. It is a concept exactly defined by the National Con- 
ference Committee on Standards of Colleges and Secondary 
Schools. The definition is substantially as follows: A unit 
represents a year’s study in any subject in a secondary school, 
constituting approximately a quarter of a full year’s work. 
A four-year secondary school curriculum should be regarded 
as representing not more than sixteen units of work. This 
notion of the unit takes the four-year high school course as 
a basis, and assumes that the length of the school year is from 
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thirty-six to forty weeks, that a period is from forty to sixty 
minutes in length, and that the study is pursued for four or 
five periods a week; but under ordinary circumstances, a satis- 
factory year’s work in any subject cannot be accomplished in 
less than one hundred and twenty sixty-minute hours or their 
"equivalent. 

Within the colleges, tampering with this unit which had 
erroneously come to be called the ‘Carnegie Unit’’ was taboo. 
Three years ago when I sought a modification of the Prince- 
ton admissions requirements I found myself blocked by this 
taboo. At this meeting last year Doctor Learned explained 
that the unit had served its original purpose in bringing the 
schools to a common understanding, but that “with changed 
conditions and better tools such norms become obsolete.” 

The essential element in the unit notion is that of time 
elapsed and the notion of time does not include the notion of 
individual differences in performance. We may, however, 
arbitrarily define the individual as an average individual, or 
as an individual any distance below or above the average. 
The unit would then be the work accomplished by the given 
individual in the given amount of time. 

In seeking to change our admissions system at Princeton 
we did nct wish to discard any notion of what a normal indi- 
vidual might be expected to accomplish in an adequate cur- 
riculum in a good school and we therefore required a base 
point. This base point was taken as resting on the definitions 
of requirements and the examinations of the College Entrance 
Examination Board. Our unit is therefore pegged. It is 
defined by reference to a secondary curriculum generally ap- 
proved and by a population comparatively stable from year 
to year. The “pass” individual—selected for purposes of 
definition—has about 35 per cent of this population below 
him and 65 per cent above him. 

We thus reach a concept of the minimum value of a unit 
defined by reference to a definite standard of attainment in 
a describable curriculum. Our curriculum at Princeton is 
built on the structure of secondary education, and as our fresh- 
man courses rest on the school courses we must maintain a 
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common link. We attempt to integrate our curriculum with 
the school curriculum through the Board’s definitions of re- 
quirements. But this unit notion is in the nature of a mini- 
mum requirement. We permit indefinite expansion above this 
point by awarding credit for honors work and by promising 
advance placement. Instead of scrapping the unit, as many 
have urged, we are seeking eventually to replace it with a 
more usable and workable concept. 

The essential characteristic of the system adopted at Prince- 
ton is the interlocking of the concepts of placement and units. 
One can see that we mean by “four units of Latin,” place- 
ment in a certain Freshman course, by “three units of Latin,” 
placement in another Freshman course, and by “‘five units of 
Latin,” placement in a Sophomore course. We have offered 
new categories of honors work which may be counted as more 
units by the applicant if he wishes, but which actually repre- 
sent a contract in which we undertake to place the student in 
an advanced course. Therefore an agreement to place a boy 
in Sophomore Latin is our immediate concern and not the 
permission to count this as five units in estimating his program. 

We continue to estimate the range and scope of a student’s 
preparation on the “fifteen unit” basis, but he may modify 
this program by attempting work of honors levels in such a 
way that the greatest elasticity and freedom of choice are al- 
lowed. He may eliminate useless electives usually offered to 
fill in the chinks and substitute therefor work which actually 
places him ahead of his class in college. 

We refuse to grant honors in single unit or one year sub- 
jects and in this way are trying to discourage piecemeal in- 
struction in miscellaneous subject matters and the bald accu- 
mulation of credits. In an effort to further the end of a cur- 
riculum more closely integrated and better adjusted to the 
needs of the individual student we have reduced the basic 
requirement to the equivalent of twelve units and have placed 
on the schools the responsibility for the rest of the student’s 
program. The basic requirement, of course, must be written 
in terms of the studies considered necessary to pursue the 
later college curriculum. Such a defined requirement is neces- 
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sary for any college which has a definite plan of approach to 
the later years. 

To make clear the mutual interrelation of units and place- 
ment let me take as an example the conventional practice with 
respect to the modern foreign languages in practically all col- 
leges. The modern language training in college is usually 
classified under the headings of “‘beginning,” “intermediate,” 
and ‘‘advanced.” ‘The three consecutive courses complete the 
so-called linguistic courses and precede the courses in litera- 
ture. The College Board gives examinations at three levels, 
known as Cp. 2, Cp. 3, and Cp. 4, roughly corresponding to 
the three college levels. Passing the Cp. 4 examination nor- 
mally completes a language requirement and places the student 
in literary and other specialized courses. Colleges have not 
used the Board examinations rigorously but have developed a 
flexible interpretation so that students with high marks in 
the Cp. 2 examination are allowed to skip the intermediate 
work and enter the advanced linguistic course, while stu- 
dents with high marks in Cp. 3 skip the advanced work and 
plunge immediately into Sophomore work in literature. The 
high mark required is around 80. This is a fairly universal 
practice and has been in operation for many years. It seems 
to have grown naturally without being seriously questioned 
or challenged as a radical tendency. 

The new Princeton plan of honors awards and advanced 
placement is nothing more than the complete generalization 
of this existing scheme throughout all subjects. It happens 
that there is no Cp. 4 English examination, but if school rec- 
ommendations and high marks in the comprehensive English 
examination place a student in a Sophomore English course, 
then obviously we have the equivalent of a “four unit’? Eng- 
lish course, regardless of what it is called. 

Until recent years at Princeton, and in many colleges now, 
Freshman English was a composition course, Sophomore Eng- 
lish was a survey course, and Junior courses were on special 
fields. Several years ago the the Sophomore course in Eng- 
lish at Princeton was pushed down into Freshman year and 
some of the specialized Junior courses were moved into Soph- 
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omore year. The old Freshman course disappeared except 
for a few traces. I cite these changes as indicating the gen- 
eral trend of an evolutionary process in which the schools 
improve the character of their training to such an extent that 
students are able to begin their work in college at progres- 
sively higher levels. Recent changes at Princeton have made 
it possible for us to place over fifty students in Sophomore 
English directly from their preparatory school classes. The 
work which these Freshmen are now doing would have been 
characteristic of Junior courses not many years ago. 

Our recent experiences in introducing the new plan of ad- 
mission have been most illuminating. An essential feature 
of the plan, if not its most important feature, involves the 
submission by the applicant of his intended program of study. 
He indicates broadly and generously the probable trend of 
his future scholastic interests and the subjects he would like 
to study in his first year. The admissions office assumes a 
guidance and placement function, and seeks to work out a 
satisfactory college program with each applicant. 

The results of this placement policy have been most ap- 
parent in the advanced modern language registrations which 
have about doubled. The number of placements beyond the 
Cp. 4 level is 122 this year as compared with 59 last year. 
This increase seems to me to be a result of the active par- 
ticipation of the students in the guidance and placement serv- 
ices offered by the admissions office. There has been no change 
in the regulations governing advanced placement in the mod- 
ern languages, merely a change in attitude. 

The present modern language situation seems to offer the 
best opportunity for an effective transition from the concept 
of units to the concept of placement. Many schools are now 
giving such excellent training in the modern languages that 
further linguistic training is unnecessary except for special 
purposes. The schools are, however, a little gun-shy with 
respect to the Cp. 4 examination. If it is possible eventually 
to substitute the dynamic concept of placement in a continuing 
course for the static concept of units, a great advance will be 
made. 
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I do not wish to simplify this problem too much by forcing 
the analogy from modern languages too far. But I do feel 
that it gives us a practical approach to many troublesome 
problems. Without indicating a solution let me merely call 
your attention to the present confused situation in the relation 
between the teaching of physics in schools and colleges. Fresh- 
man courses in physics continuing beyond the preparatory 
school courses seem to be built on the assumption that little 
has been learned in school and that much of the work should 
therefore be repeated. The new student does not realize 
that his college course is going more deeply into each topic— 
he merely senses the repetition. This makes for a poor atti- 
tude in the college classes and a generally unsatisfactory situ- 
ation. Perhaps no one can solve the problem immediately, 
but everyone realizes that the successful solution must involve 
the integration of school and college physics. The problem 
must be approached from the point of view of a transfer from 
school to college. 

The examples chosen to indicate what seems to me to be 
the proper approach to these problems have all been taken 
from the single subject matters. But it is obvious that we 
are dealing with much larger aggregates than those repre- 
sented by defined courses. The work of Crawford and Burn- 
ham at Yale in developing prediction formulae illustrates this 
point clearly. And the individual who must in the end as- 
semble the information and decide on the placement goes way 
beyond the variables combined in the multiple regression equa- 
tion and has a far broader base for his judgment. But he 
does not reach a completely generalized base. The general 
trend of the technical studies and their practical applications 
are in the direction of aggregations larger than single courses 
and smaller than the whole. Such aggregations are loosely 
represented by English-Latin-history, mathematics and science, 
and so on. At the moment we seem to have abandoned the 
general factor theory of education. 

But although we look within the school record and the 
examination record for differential cues, we all seek and use 
one general index of the school record. Such indices are now 
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compiled at Princeton and at Yale by somewhat different 
methods. Professor Crawford can explain the Yale method 
and I will explain the method used at Princeton. The Yale 
method is better. At Princeton we keep school ledgers show- 
ing beside each individual his rank in his school class and his 
subsequent college grade. The school ranks are converted to 
a common scale and the average represents the selection from 
that school. Knowing the average attained grade of the en- 
tire class, of each school group, and correcting for selection, 
one may obtain a “converted school grade”’ which is a service- 
able general index. From the position of the new applicant 
in his school class this index assigns a probable grade on the 
basis of the performance of all boys who have entered Prince- 
ton from that school in the six years preceding. Our betting 
system correlates about .65 with Freshman standing. The 
Yale betting system correlates about .70 with Freshman 
standing. 

Both betting systems work well without reference to the 
actual grades in the June examinations of the College Board, 
but both are in fact based on a system of secondary education 
designed to meet the definitions of requirements of the Col- 
lege Board. Neither system would work in a vacuum, and 
it is fallacious to argue that because one’s multiple correla- 
tions are not increased much by adding in the final marks one 
therefore does not need the marks. The essential point is 
that these apparently independent results are obtained within 
a framework defined by the Board, and that they are largely 
dependent on that framework. 

Our betting system at Princeton is set up in April, about 
six months before admission, and provides the basis for the 
placement of students in the new work which is open to them 
in college. I do not wish to leave the impression that we 
regard all work as necessarily a continuation of studies pre- 
viously pursued. There is a great deal of advanced place- 
ment in subjects not offered in school. Those who will 
probably be in the upper third of the Freshman class are per- 
mitted one Sophomore elective, those in the upper twelfth, 
two Sophomore electives, these electives being in new courses 
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over and above the advanced placement accompanying the 
honors award. 

The placement and guidance service which is a part of the 
admissions office now has 136 Freshmen enrolled in one sub- 
ject ahead of their class, 57 Freshmen enrolled in two sub- 
jects, 15 enrolled in three subjects, four enrolled in four 
subjects, and one enrolled in five subjects. Over a third of 
the class is one year ahead in one or more subjects. It is im- 
possible to say where the continued extension of this policy 
will lead, but our faculty has adopted the plan outlined with 
all of its implications. The one fixed element in the situation 
seems to be our upper-class plan of study culminating in the 
final comprehensive examination. This seems to me to rep- 
resent a concept of work at the university level. There seems 
to be no correspondingly fixed concept of Freshman and Sopho- 
more years. Under the plan now in operation these years 
are shared with the schools and boys may be pushed ahead 
into upper-class work as soon as they are ready for it. The 
student who enters the upper-class program one year after 
admission has before him the opportunity of work at graduate 
levels with the master’s degree as a possible goal. The notion 
of quality of performance has been substituted for the notion 
of time and units throughout. At least we seem to have left 
behind the notion of “‘one hundred and twenty sixty-minute 
hours, or their equivalent.” 

Although I was invited to address this group on the sub- 
ject of the new Princeton plan of admission, I cannot resist 
the temptation to go beyond this topic and say something 
about examinations. The attitude towards examinations at 
Princeton and many other of the examining colleges is not that 
of the test technician purely and simply. It is true that we 
need smaller errors of measurement than we have at the 
present time, but we cannot sacrifice other aspects of exami- 
nations to the purely placement function. 

My point may best be illustrated by reference to the gen- 
eral problem of examining in English. The verbal section of 
the Scholastic Aptitude Test is probably the most reliable 
measure yet developed and it has some correlation with Eng- 
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lish grades in college, yet it is not English. Similarly objective 
tests in English which have a low error of reading must neces- 
sarily restrict themselves to measures of vocabulary; proof 
reading for errors in grammar, punctuation, and spelling; in- 
formation tests on literature; and similar fragmentary devices. 
But this is not English. 

The Board’s definition of the requirement in comprehensive 
English seems to be universally approved. Even some of the 
progressives who are in revolt against all measurement object 
neither to the requirement nor to the examination. It is the 
general opinion that this requirement has promoted effective 
teaching and has held a stimulating goal before the candidate. 
The difficulties connected with the use of this examination 
arise from the error of measurement. It is hard to read. 

This year the Board tried an entirely new procedure in the 
reading of the Comprehensive English papers. The examina- 
tion included five questions and the candidates were instructed 
to write the answers to three of the questions in one book and 
two of the questions in another book. The two answer books 
for each candidate were numbered in duplicate and sent to 
different groups of readers for appraisal. The first rating of 
each half-script was then obscured and returned to a different 
reader for an independent appraisal. The readers were in- 
structed not to use numbers but to judge the performance on 
each question on an eight-point quality scale, for which mimeo- 
graphed standards were supplied. Numbers were subsequently 
attached to the literal quality scale on the basis of frequency 
of use of the eight qualities rated. The four independent 
readings which were thus secured for each candidate were 
then combined and final grades were assigned by a grading 
committee which had before it the reference of these marks 
to the generalized distribution of Board marks in all subjects 
in other years. 

Before the reports were sent to the colleges a Hollerith 
card was punched for each of the 6,900 books read in this 
manner and we now have available for the first time an enor- 
mous body of information concerning this type of subjective 
appraisal of a candidate’s written work. We have not only 
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the 45 intercorrelations of all of the judgments expressed in 
the ten grades but also six or seven hundred correlations of 
individual readers against the general group of readers. This 
study is not yet completed but it indicates the possibility of 
obtaining a very marked reduction in the size of the error of 
measurement. We know that the judgments of the independent 
readers on single questions will correlate as high as .70 or 
.80. Linearity studies of correlation plots indicate the man- 
ner in which the rating scale may be modified in order to obtain 
better relationships between judgments. We suspect that the 
examination itself may be modified in such a way that a higher 
intercorrelation of questions will generate a final mark more 
descriptive of the candidate. 

At this meeting last year Doctor Learned expressed the 
opinion that the Board had reduced the reading of its papers 
as nearly as possible to a flawless formula and that the defects 
seemed to be inherent in the discursive written examination. 
The study which I have just described suggests to me the 
enormous possibilities of developing the art of reading the 
written examination beyond that ever before considered 
possible. 

Several years ago Doctor Learned gave a very excellent 
account of the European educational machinery and drew strik- 
ing comparisons between their systems and ours. One of the 
contrasts most consistently urged was that between the Euro- 
pean and the American attitude towards examinations. Speak- 
ing of the importance of the examination in England he said: 


“It is clear that English teachers consider a final general 
examination as an integral part of their educational system. 
What in this country is variously regarded, often involun- 
tarily, as a necessary, or an unnecessary, evil, becomes with 
them the main pillar of the educational process. It is much 
more than an inducement to hard thinking, important as that 
is. A clear scholastic goal ahead is believed to encourage as 
does nothing else the conviction of responsibility and moral 
as well as the mental training of intellectual youth. Term 
tests and marks are universal there, as here, but there they 
are used only for estimating and recording progress and for 
assigning prizes and class standing. To substitute them on the 
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installment plan for the requirement that a pupil actually set 
up and grapple with an exacting intellectual task that justifies 
his claims is like proving fitness to run a two-mile race by 


running half a mile each year for four years and adding up 
the results.” 


The attitude of our examining colleges is essentially the 
English attitude. The most representative secondary schools 
here are in substantial agreement. The American contribu- 
tions to the art of examining have been in technical improve- 
ments and have resulted from our natural inventiveness. The 
successful solution of the problem demands the reconciliation 
of the two points of view. 

I have no desire here to minimize or attempt to conceal 
the very obvious errors in our present examination system. 
But I do not feel that these difficulties are insuperable. What 
is needed, to my mind, is a carefully balanced and completely 
integrated system of examinations including comprehensive 
goal examinations as the end with the various stages of de- 
velopment towards this goal measured and described as accu- 
rately as possible. With these two aspects of examinations 
in mind I see a reconcilation between the points of view of the 
College Entrance Examination Board and the Educational 
Records Bureau. 

Cart C. BrRIGHAM, 
Princeton University. 





The Technique of Constructing Tests’ 
INTRODUCTION BY Dr. C. R. MANN 


The topic of the afternoon is Testing Techniques. This 
is a matter of growing significance to the schools, to education 
in general. I have watched the growth of this testing move- 
ment for a great many years. I remember very well when I 
was making a study of engineering schools some years ago, the 
testing technique was in its infancy. I had the temerity to 
propose to the engineering committee that had charge of that 
study that we get Professor Thorndike, the pioneer in this 
movement, to devise and try out some of these tests in engi- 
neering schools as an aid to determining the quality of the engi- 
neering instruction. I was almost discharged as special investi- 
gator for the committee. It took me about five months to 
persuade the committee to allow this experiment to be made. 

A little later, in the War Department, during the War, the 
Chief of Engineers had sixty young West Point graduates 
thrust upon him. They had graduated after two years of 
work at West Point and been assigned to the Engineer Corps. 
He felt that they were not competent to be engineer officers 
without some additional instruction. So he asked me to help 
him organize a small school of engineering at the engineer 
camp at Fort Humphreys. After some debate with him, I 
succeeded in persuading him to permit a testing expert to come 
down and test those sixty young graduates in various ways, 
as a basis for developing the kind of instruction that might be 
most helpful to them. We secured a young testing expert 
from Columbia. He came to Fort Humphreys and spent a 
couple of weeks making various tests on this group of sixty 
young West Point graduates. Finally he turned in a report 
grouping them in various ways according to their IQ’s, and 
various other things. I took the report over to the Chief of 
Engineers and told him what it meant. He glanced it over and 


1Paper read at the Second Joint Conference on College Entrance and 
Educational Guidance Problems, New York, November 3, 1933. 
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said, “Well, it gets me, how these highbrows take two weeks 
to find out what any damned fool knows in the first place.” 
That was the state of the public’s respect for the testing 
program in 1918. 

Respect for the testing program has enormously increased 
since those days. In proof of that fact, I refer to Commis- 
sioner Zook’s paper yesterday morning before this conference, 
in which he made it clear that the North Central Association 
is engaged in a fundamental revision of the basis of accredit- 
ing. One of the factors that has been influential in making the 
authorities of that Association think that a revision of the 
accrediting process is desirable is the work that was done in 
Indiana, Iowa, and other states with this testing program in 
the public schools. 

The results showed that a lot of the youngsters in unac- 
credited high schools throughout the state didn’t have any 
more sense than to do better or as well on the examinations 
as did the students in the accredited schools. That fact, to- 
gether with the fact that the students in United States history 
classes, for example, taught by a young teacher who had never 
had any specific training in teaching United States history, 
often did as well in the tests as did students who were under 
teachers who had had a lot of professional technical training 
in the specific subject of teaching United States history, rather 
disturbed the authorities. The result has been that the ac- 
crediting process is in process of revision. That shows, at 
least, that the testing program has made sufficient progress to 
be taken seriously. The results of these tests are being studied 
and made use of. They are invading the sacred ranks of 
academic accrediting and winning public recognition of their 
significance. 

During this process of winning public recognition, the testers 
themselves have not been idle. They have been growing and 
changing their conception of the way in which tests may be 
used and of the value that may be derived from them. The 
earlier efforts, as I remember them, were directed mainly to 
the construction of tests that would replace the ordinary exam- 
ination in determining the flunking mark for students in par- 
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ticular subjects. It was argued that those tests were much 
more impersonal, and thus did away with the subjective esti- 
mates of teachers. They were devised to give a more objective 
means of determining academic proficiency in particular 
courses. Tests could then be used as a basis of promotion, 
so that a student could be advanced more rapidly if he were 
showing greater proficiency. Achievement might then sup- 
plant credits as a basis for promotion. I remember that when 
our Cooperative Test Service was established, one of the main 
arguments that brought support for the enterprise was the 
hope that this experiment would help us learn how to sub- 
stitute achievement for credits as a basis for promotion. 

Now the testers tell me they are finding that the tests are 
even more valuable as a basis of guidance. They may yet be 
used to determine which studies are educationally profitable for 
a student and which are not. This opens up a vast new field of 
educational experiment. So the testers themselves are growing 
and the movement is growing. We mustn’t expect too much 
of it all at once because it is in a state of flux. It is certainly 
contributing very largely to the transformation that is going 
on in education at the present time. 

Among the testers Dr. Lindquist, who is going to talk to us 
today, is one of the leaders in the movement for the improve- 
ment of these tests. He is an expert at testing tests and find- 
ing out what they mean for particular purposes. One chal- 
lenge was thrown up to Dr. Lindquist by Commissioner Zook 
yesterday when he said that he would be glad if a testing pro- 
gram could be arranged that would help the accrediting agen- 
cies to determine the educational efficiency of an institution. 
If we could have a testing program when a student enters an 
institution, and then keep appropriate records through two or 
three years, and then have a second set of tests that would 
indicate how much that student had advanced, we would have 
one valuable new type of information for the accrediting 
agencies that would be perhaps more reasonable than are the 
number of books in the library and the other mechanical 
devices that have been used. Thus one of the challenges that 
the testers have before them is the challenge of showing how 
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those tests can be used as a basis for measuring educational 
efficiency of an institution for the purposes of accrediting. 

I would like to present one other challenge to the testers. 
It is one that is coming to them within the next few months, 
because the testing programs that have been developed during 
the past fifteen years were developed from the point of view 
that we all had during the war and immediately thereafter, 
when there were more jobs than men. Then we developed 
and used the tests to reveal special proficiencies of particular 
people in order to place them in particular jobs. Now the 
situation is totally reversed. We have more men than jobs. 
Unemployment is the critical issue of the present time socially 
and educationally. Therefore the tests must now be used not as 
a means of fitting men to jobs, but as a means of discovering 
what the particular capacities of particular individuals are and 
how those individuals may best be developed to become social 
assets instead of liabilities. This is a new challenge to the 
testing profession. I am sure that the testing profession will 
meet the challenge effectively through their experimentation 
with these tests. 

We are very fortunate in having with us today Dr. Lind- 
quist who has charge of the Iowa State testing program which 
was one of the overt acts that made the North Central Asso- 
ciation realize that revision of the accrediting system is neces- 
sary. Dr. Lindquist is working closely with the Cooperative 
Test Service on this subject. I take great pleasure in intro- 
ducing Dr. Lindquist. 


Appress BY Dr. E. F. Linpaqu!IstT 


HE specific considerations which determine the form and 
the content of modern achievement examinations, par- 
ticularly of the type now being prepared by the Coopera- 
tive Test Service and used in your own Educational Records 
Bureau program, are, in the main, technical considerations. 
These considerations have arisen out of the new uses to which 
the examination is being put, particularly in educational guid- 
ance, and out of the consequent necessity for general applica- 
bility of the same examination to a wide variety and range of 
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local teaching situations and of levels of achievement. They 
have resulted in a type of test which differs significantly from 
the traditional examination, not only in external form, but 
even more noticeably in the specific functions that it is intended 
to serve, and in the nature of the content upon which it is 
based. 

The full significance of these technical considerations and 
of the limitations in function and content which they have 
imposed on the general achievement test has not as yet secured 
general recognition. Test users and teachers in general are 
still attempting to evaluate the modern achievement examina- 
tion in the light of traditional standards which are no longer 
applicable (if, indeed, they ever were valid), and are still 
retaining many erroneous ideas which originated with the tra- 
ditional examination. The objective achievement examination 
is therefore under constant criticism for its so-called ‘‘failure” 
to perform certain of the vaguely defined functions formerly 
claimed for the traditional examination. Objective testing 
techniques in general, and the standardized test in particular, 
are still regarded with various degrees of suspicion and dis- 
trust by perhaps the great majority of their potential users. 
There is some evidence, indeed, that in the last few years 
there has been a period of decided reaction against the new- 
type test, during which many of the earlier prejudices have 
been revived and strengthened. 

This situation is particularly unfortunate in relation to the 
major interests that are represented at this conference. The 
greatest hope for an educational guidance program that will 
begin to function effectively early in the high school course 
now appears to lie in the systematic use of achievement and 
aptitude test results over a period of several years preceding 
entrance to college. It is to make possible educational guid- 
ance of this type that organizations such as the Cooperative 
Test Service and the Educational Records Bureau have come 
into existence. These organizations, however, can never suc- 
ceed to the extent which they deserve, nor can their possi- 
bilities for educational guidance be widely realized, until the 
instruments which they employ (i.e., the examinations them- 
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selves) are fully understood, and until the present attitude of 
distrust and suspicion has been dispelled. This lack of confi- 
dence in the objective achievement examination is, I believe, 
one of the major obstacles to progress along the lines indicated 
by this conference. There are few, if any, teachers or school 
administrators who do not recognize that there is a very defi- 
nite need for more intelligent and more effective procedures 
in educational and vocational guidance; nor are there many 
who are not in full sympathy with the avowed purposes of such 
organizations as the Educational Records Bureau. There are 
very many, however, who, because of their lack of confidence 
in the instruments employed, are not availing themselves of 
the services offered. There is at present, then, a very crucial 
need for a clearer understanding, on the part of all concerned, 
of the technical limitations of a test of the general achieve- 
ment type, and for more adequate appreciation of the precise 
functions which, in view of these limitations, it may reasonably 
be expected to perform. Once these functions and limitations 
are clearly understood, much of the criticism now directed 
against the general achievement test will disappear, and with 
it will disappear, I believe, much of the resistance now offered 
to the regional testing program and to current proposals for 
better educational guidance. 

It is my purpose in this discussion to draw your attention 
to certain of these more technical considerations in general 
achievement testing, and to attempt to show their significance 
in relation to the form, content, and functions of the general 
achievement test. In particular, I shall try to demonstrate 
how dangerously fallacious and misleading are some of the 
ideas about achievement testing which are now widely preva- 
lent and generally accepted. 

I shall begin by simply reviewing, without any comment, a 
few of these prevalent ideas. I should like to request that, as 
I review these ideas, each of you ask yourself specifically if you 
have hitherto considered any of them as in any sense erroneous 
or misconceived. (My intention, you see, is to try to provoke 
your interest to the point at which you will listen more pa- 
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tiently to the very dry technical discussion which I am going to 
impose upon you!) 

Most of these misconceptions arise out of the general idea 
that the criteria used in the evaluation of curriculum content 
are in themselves sufficient criteria for the evaluation of test 
content—in other words, that the validity of the content of a 
general achievement test may be judged by the same standards 
that are used in the evaluation of the course of study. As a 
result of this basic misconception, it is quite generally believed 
that what should be learned, as judged by curricular objectives, 
is the only important consideration in the selection of test con- 
tent; that the content of a general achievement test should con- 
stitute a strictly representative sample or cross-section of ac- 
cepted curriculum content, and that, as such, it may be con- 
sidered as setting a sort of “standard” to which teachers may 
and should “‘point”’ their instruction. 

Two additional misconceptions may well be considered to- 
gether with those just given. One of these is the idea that 
a general achievement test can and should be effective in the 
diagnosis of individual pupil difficulties. The other is the 
particularly persistent idea that the items in a general achieve- 
ment test should consist predominantly, if not exclusively, of 
so-called ‘‘reasoning”’ or “‘thought” questions, and that tests 
which are exclusively or largely “informational” in character 
cannot provide valid measures of achievement. 

Perhaps I had better admit, before continuing, that I may 
have been unnecessarily provocative in labeling each of these 
ideas flatly as a misconception. Most of them are erroneous 
in part only, or in certain of their presumed implications, and 
are, within certain limits, quite sound and extremely important. 
There are very definite and restricted limits, however, beyond 
which they do not apply. It is the definition of these limits, 
which are so seriously ignored in current criticisms of the gen- 
eral achievement test, that is the specific purpose of the remain- 
ing discussion. 

School examinations and the measures derived from them 
are used to serve a wide variety of purposes. In general, 
however, they have only two immediate objectives. The first 
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of these is to rank the students tested in the order of their 
total achievement in a given field of achievement. The second 
is to discover and to identify within the given field the specific 
weaknesses, errors and deficiencies in the achievement of the 
individual pupil. Nearly all of the ultimate uses of the school 
examination, as, e.g., in the improvement of instruction, in 
sectioning, in promotion, or in educational guidance, depend 
directly upon the effectiveness with which one or both of these 
immediate objectives is performed. 

It would be highly desirable, of course, if both of these 
purposes could be effectively served by the same examination. 
Any such combination of functions in a single test, however, 
is, for reasons which I shall later present, definitely imprac- 
ticable if not impossible. In order to make a test highly 
efficient in the measurement of general achievement, its diag- 
nostic values must be sacrificed. A test that is to be truly 
diagnostic, on the other hand, would have to be made so long 
and time-consuming that its use with other equally long tests 
in a comprehensive testing program would be out of the ques- 
tion. Most general achievement tests, therefore, such as those 
used in the Educational Records Bureau program, are admit- 
tedly and of necessity intended only to provide measures of 
general achievement. What diagnostic values they may have 
are in most cases only incidental and insignificant. 

In order better to understand the necessity for this and other 
limitations in function and content, let us consider briefly the 
significant characteristics and essential features of a general 
achievement test. Some of these characteristics will perhaps 
appear so obvious to you that they will seem hardly in need of 
review, but their implications, I am sure, are not so generally 
appreciated. 

A test of general achievement is, by definition, one which is 
designed to express, in terms of a single score, a pupil’s relative 
achievement in a given field of subject matter. In considera- 
tion of the wide or indeterminate scope of the fields of sub- 
ject matter for which such tests are usually designed, none of 
them obviously can test directly and independently for the 
acquisition of each of the specific ideas, skills, abilities, and 
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items of information which it might be desirable for the pupil 
to acquire. The items constituting any general achievement 
test must be considered as representing only a very restricted 
sampling of all of the items that might be constructed on 
the basis of the subject matter involved. Few schools can or 
will use, in a comprehensive program, a general achievement 
test in a single subject that requires more than two hours for 
its administration. It is not practicable, therefore, to attempt 
to include, even in a test of the objective type, more than one 
or two hundred out of the many thousands of acceptable items 
that could be prepared. 

With these very severe restrictions upon the scope of the 
sampling permitted, it is highly important that each individual 
test item contribute as much as possible to the validity of the 
whole test. With so few items permissible, there must be no 
“duds” or non-functioning items. The validity of the whole 
test depends, by definition, upon the degree to which the 
scores obtained from it rank the pupils in the true order of 
their total achievement. The function of any individual item 
is, of course, the same as the function of the whole test. The 
validity of any single item must depend, then, upon the effec- 
tiveness with which that item of itself discriminates between 
pupils who are inferior and superior in total achievement. 

It follows immediately that no item which is answered cor- 
rectly by all pupils in a given group can be of any functional 
value in a general achievement test intended for that group, 
nor can any item which is answered correctly by none of the 
pupils tested. Any item to which all of the pupils respond 
alike, whether correctly or incorrectly, obviously cannot serve 
to discriminate between those pupils in any way, and hence has 
no place in a general achievement test whose sole purpose is to 
discriminate. 

The first technical requirement, then, for each and every 
item in a general achievement test intended for a given group, 
is that it must be answered correctly by some but not by all of 
the pupils in that group. This requirement alone immediately 
establishes a very fundamental difference in the content of 
diagnostic and of general achievement tests. A diagnostic test 
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is one intended to discover specific rather than general deficien- 
cies. It is a test on which a single total or composite score 
is of little or no significance, but on which part scores, or 
numbers of correct responses to individual items, are the meas- 
ures sought. In such a test it may be very desirable to know 
that there are certain things which have been learned by all 
or by none of the pupils tested. Such information may obvi- 
ously be of value, as, e.g., in taking an inventory of the initial 
achievements of a group of pupils at the beginning of a course 
of instruction. For the purpose of ranking pupils in order of 
their achievement, however, such items would be of no value. 
Their presence in a general achievement test would, in fact, 
positively lower its efficiency by taking the place of other items 
that do have discriminating power. 

The significance of the difference between diagnostic and 
general achievement tests becomes still more apparent upon 
consideration of a second technical requirement for general 
achievement test items. This second requirement, almost as 
obvious as the first, is that the items in a general achievement 
test must be distributed along the difficulty scale, with specific 
reference to the group for which the test is intended. A gen- 
eral achievement test must discriminate between pupils at all 
levels of achievement at which it finds them. It must contain 
some very easy items, to discriminate between pupils who are 
low in ability and achievement, it must contain some items of 
intermediate difficulty to discriminate between pupils of aver- 
age ability, and it must contain some items high in difficulty 
to discriminate between those pupils who are “‘very superior”’ 
and those who are just ‘‘above average”’ in achievement. Some 
items will be missed by 10 per cent, some by 20 per cent, and 
some by 90 per cent of the pupils, with the whole range of 
difficulty represented. 

Now the average difficulty and the range in difficulty of the 
items in a general achievement test, for the pupils in a given 
group, are clearly a function of the level and range of achieve- 
ment which actually characterize that group. Whether an item 
is easy or difficult for a certain group depends upon how much 
that group has learned. An item that is easy for one group 
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may be hard for another. The level of difficulty and the range 
of difficulty of the items in a general achievement test must, 
therefore, be specifically adjusted to the particular group to 
which the test is to be administered. How well it will dis- 
criminate within that group depends upon how well that 
adjustment has been made. 

Let us see more specifically what this means with reference, 
e.g., to the tests used in the Educational Records Bureau pro- 
gram. The group for which these tests are intended includes 
pupils from a wide variety of types of schools, and with great 
variability in the levels of achievement from school to school. 
We all have some notion of how very wide is the range in 
actual achievement in this large and heterogeneous group of 
pupils. It includes pupils all the way from those you would 
characterize as “hopelessly dumb,” as well as very poorly 
taught, to those in the most efficient schools and of genius or 
near genius calibre. A single general achievement test, how- 
ever, must if possible discriminate between pupils at all of 
these widely varying levels of achievement. It must contain 
a due proportion of items which even the poorest of these 
students can answer, as well as a certain number of items to 
which only a few of the best of these students can respond 
correctly. Unless the test has these characteristics, it will not 
rank in their true order the pupils at the lower end of the 
scale of achievement, nor will it indicate the true status, in 
relation to the whole group, of those pupils who are able and 
well instructed. 

Obvious as this technical requirement may seem, many of 
its logically unavoidable implications have been persistently 
ignored. This requirement means, first of all, that the final 
consideration in the selection of test items is not what should 
be learned, but what actually has been learned in the group 
to be tested. The items in a general achievement test must 
be adjusted in difficulty to the group to be tested, but the 
“difficulty” of any item is, after all, simply the proportion of 
the pupils in that group who have learned how to, or who can, 
make the correct response. The requirement that the items 
in a general achievement test must be distributed along the 
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difficulty scale may therefore be restated as follows: If we 
think of the entire group of students as separated into a num- 
ber of levels of achievement, then for each of these levels the 
test must contain a due proportion of items calling for infor- 
mation that the pupils at that level have learned, or for ideas 
and generalizations that they do understand, or for judg- 
ments, applications or reasoning of which they are capable. 
The lowest level of achievement in a group as large and hetero- 
geneous as that for which the Educational Records Bureau 
tests are intended is a low level indeed, but the test must 
contain some items adapted to that level. In the last analysis, 
then, what may legitimately be included in a general achieve- 
ment test depends, not only upon what ought to be learned, 
but much more significantly, upon what actually has been 
achieved, and upon the way in which those achievements are 
distributed. 

There is, as all of you know, a very real and very wide gap 
between our hopes and our achievements in teaching. What 
we aim to accomplish, as indicated by our neatly phrased state- 
ments of objectives, and what we actually do accomplish, are, 
to say the least, not quite identical. Consider, e.g., an avowed 
aim of high school instruction in the social studies—‘“‘to de- 
velop a reasoned understanding of, and ability to cope with, 
current social, economic, and civic problems.” There is little 
wonder that the content of general achievement tests does 
not seem to “‘square’’ with objectives of this type. There is, 
indeed, a very noticeable difference between what we should 
like to have our pupils learn, and that for which they are 
tested in a general achievement test—particularly if that test 
is well constructed and properly adjusted in difficulty. 

During the past five years I have helped to prepare most 
of the examinations in the social studies distributed by the 
Cooperative Test Service, including some of those recently 
used in the Educational Records Bureau program. In that 
capacity, I have been the recipient of a great many criticisms 
of these tests. The most frequently occurring of these criti- 
cisms is that the tests have been too factual or informational 
in character—that they have been too much limited to the 
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testing of pure information or of a low level of understanding. 
One answer to that criticism is that we have attempted, as best 
we can, to adjust these tests to the type and level of under- 
standing and of achievement which actually characterizes the 
pupils to whom the tests are to be given. If only a negligible 
proportion of high school pupils exceed a given level of under- 
standing, then there can be no point in including in the test a 
large proportion of items that go beyond that level. It should 
be obvious, it seems to me, that an achievement test cannot 
measure something which does not exist in the group to be 
tested. 

As a matter of fact we have, in our attempts to satisfy the 
critics, frequently been in danger of erring in the other direc- 
tion. In many instances we have included in our experimental 
editions items which, because they tested for understanding 
of a relatively high order, appeared to be particularly accept- 
able from the critic’s point of view. Upon actual trial, how- 
ever, many of these items proved to be too difficult for inclu- 
sion in the final test form. Worse than that, some of them 
were answered correctly more often by the very inferior pupils, 
who guessed blindly, than by the best pupils, who at least tried 
to reason! Items of this kind are worse than useless in a 
general achievement test, since their effect is to penalize the 
superior students. 

How an overly difficult item may thus not only fail to con- 
tribute to the purpose of a general achievement test, but may 
actually interfere with that purpose by penalizing the superior 
student, is worth at least a brief consideration at this point. 
A third technical requirement of an item in a general achieve- 
ment test, in addition to the two I have already described, is 
that the pupils who respond correctly to that item must, on 
the average, be superior in general or total achievement to 
those who respond incorrectly to the item. More specifically, 
if, e.g., 200 out of 1,000 students succeed on a given item, then 
these 200 students must, on the average, be superior, in achieve- 
ment in the whole field tested to the 800 who fail on the item. 
This is only equivalent to saying again that each item in a 
general achievement test must of itself discriminate between 
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pupils who are inferior and superior in general achievement. 
An item may, however, discriminate in the wrong direction— 
it may be answered correctly more often by the poorer than 
by the better students—it may raise the total score of the 
poor students and lower the total score on the test of those 
who are superior. 

Let me illustrate how this may happen in the case of a mul- 
tiple choice item intended, let us say, to test for the pupil’s 
ability to interpret a given historical event. The item might 
consist of a direct question (similar to that which might be 
asked in an essay examination) followed by, say, four possible 
interpretations. The task for the pupil would be to select 
the one acceptable interpretation from the four given. If 
such an item is to test for a relatively high level of under- 
standing, then it is essential that the three wrong responses be 
not too obviously incorrect. Each alternate response must be 
highly plausible, i.e., it must have the appearance of being 
logically consistent with many of the facts known to the stu- 
dent. There is considerable danger, however, that in this 
attempt to test for more than only a superficial understanding, 
the alternate responses may be made so plausible that they 
will defeat their own purpose. There is a danger that they 
will appeal more strongly to the superior student, who has the 
information that makes them appear plausible, than they will 
to the uninformed student, who may not know even enough 
to recognize their plausibility. The uninformed student, not 
having the information which makes the wrong response plau- 
sible, may avoid it and select the correct response—either by 
guessing blindly or because he has memorized something 
which he doesn’t understand—while the better students may 
be almost invariably misled by their superior but still insuf- 
ficient information or understanding. The result will be that 
the poorer students will, on the average, score higher on such 
items than those who are superior. Pope may very well have 
been thinking of objective test items when he said, “A little 
knowledge is a dangerous thing.” 

In a general achievement test intended for a given group, 
then, an item testing for a high level of understanding will 
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function effectively only if there is in that group a significant 
proportion of students with sufficient understanding to reject 
the plausible wrong responses. If in the group tested there 
is not a reasonable number of such students, the item will not 
only fail to discriminate as it should, but may actually dis- 
criminate in the wrong direction. Such items can ordinarily 
be detected only upon actual trial with a representative group 
of pupils and upon statistical analysis of the results. In other 
words, their detection is an empirical, rather than a logical, 
process. If general achievement tests are to have their maxi- 
mum efficiency, it is extremely important that items of this 
type be rejected through preliminary or experimental tryout 
of all test materials. 

If this fact were more generally appreciated, there would 
perhaps be fewer demands for more items of the so-called 
“thought” or “pure reasoning”’ variety in our general achieve- 
ment tests. We hear a great deal of talk about the impor- 
tance of teaching pupils to think, and about the dangers of 
“informational” teaching, and we are reminded again and 
again that our tests are vicious because they will encourage 
teachers to teach facts. These criticisms are certainly well 
intended, and there is much in them that deserves serious 
consideration. We must not go so far, however, as to forget 
that no student ever will or can think until he has precise 
and sound information to think with, and that all too many 
of our pupils are inherently incapable of ever doing the brand 
of thinking that we talk about. 

There can be no question that the quality of reasoning and 
the level of understanding actually attained by high school 
pupils are in general much lower than might be wished. 
Whether we like it or not, the type of achievement now attained 
by most high school pupils is definitely on a low level of under- 
standing and is largely informational in character. It will 
therefore continue to be necessary, in the construction of 
general achievement tests which are to discriminate between 
pupils at the level at which it finds them, to limit a large pro- 
portion of the items to well-selected information and to a low 
level of understanding. This is not a situation for which the 
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test constructor should be blamed—it is a matter of technical 
necessity rather than of choice. The blame, if any blame is 
involved, should rest with the pupils tested because they have 
not learned more, or with their teachers, because they have 
not taught better |! 

The content of a general achievement test, again, must be 
selected with specific reference to what has been achieved in 
the particular group for which the test is intended. Each of 
its items must be answered correctly by some but not by all of 
the pupils tested, and the number of items at each level of 
difficulty must be somewhat proportional to the number of 
pupils who have reached a corresponding level of achievement. 
There are still further implications of these technical require- 
ments that we have thus far only indirectly considered. 

In relation to the ideas which I listed earlier in this discus- 
sion, these requirements mean that curriculum validity is not 
synonymous with test validity, that the content of even the 
best course of study is in itself not a sufficient guide to the 
selection of test items, and that the content of a general 
achievement test may not be a strictly representative cross- 
section of accepted curriculum content. By this, however, I 
certainly do not mean to say that the accepted objectives of 
instruction or the content of established courses of study may 
be disregarded in test construction. It is of course extremely 
important that nothing be included in a general achievement 
test which does not clearly ‘“‘belong” to the field tested or which 
is not consistent with the accepted objectives of instruction in 
that field. Curriculum objectives and courses of study do set 
the broad limits of the content from which achievement test 
items are selected, and these broad limits must be very care- 
fully observed. Within these broad limits, however, there 
are many elements of content which, for the reasons that I 
have given, may not be used in achievement test construction. 
It is only from within the relatively very narrow limits of 
what has been learned that test item content may be selected. 
The content of an achievement test, therefore, cannot be a 
cross-section of the whole content of the course of study—it 
can only be a cross-section of those elements in the course of 
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study which some but not all of the pupils have actually 
acquired. 

Achievement test construction is therefore not a purely 
logical process, guided only by considerations of curriculum 
objectives. It is primarily an empirical process, in which con- 
siderations of objectives may determine what may be tried 
out in experimental editions of the test, but in which the objec- 
tive evidence secured from the tryout must be allowed to 
determine finally which items may be retained in the final form. 

There is just one more implication of these technical re- 
quirements which I should like to consider briefly before con- 
cluding. There is a very definite tendency, among teachers 
and test users in general, to feel that the content of a general 
achievement test is or should be a type of curriculum “‘stand- 
ard” to which their teaching should be made to conform. In 
other words, they tend to consider the test as a sort of abbre- 
viated course of study, or as a source of specific suggestions 
for curriculum content, and they therefore often attempt to 
“point” their teaching toward that content. These dangerous 
tendencies and misconceptions again arise out of the general 
failure to recognize the specific functions and the content limi- 
tations of a general achievement test. The content of a general 
achievement test does not describe what should be taught—it 
describes only that part of what should be achieved which 
actually has been achieved. It is, in a sense, a picture of the 
present status, not of the desired status of achievement. The 
general achievement test is purely a measuring instrument, 
not a teaching instrument. It no more represents the goal 
of teaching than the penny scale on the street corner repre- 
sents the goal of physical weight. Ideally, the general achieve- 
ment test should no more influence teaching content and pro- 
cedures than the penny scale influences our ideals of physical 
perfection. 

Unfortunately, however, what the attitude toward the gen- 
eral achievement test should be and what the general attitude 
now is differ very considerably. Whether we like it or not, 
general achievement tests do influence teaching, and will con- 
tinue to do so until test users become fully enlightened con- 
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cerning the nature and function of such tests. For the present, 
therefore, we are often forced to make compromises with 
technical requirements in test construction. In our high school 
achievement testing program in lowa, e.g., we deliberately 
make use of our examinations to effect certain changes in 
teaching emphasis, and we do so, perhaps, at some sacrifice 
in the functional effectiveness of our tests for measurement 
purposes. Our philosophy is that since the tests are in any 
event bound to influence teaching, we might as well insure 
that their influence is in the right direction. That practice is 
admittedly inconsistent with what I have been saying, but the 
compromise seems to be demanded by the irrationality of the 
situation in which we are working—and by that I do not mean 
to admit that popular educational philosophies in lowa are 
any less rational than they are elsewhere! 

In conclusion, let me summarize briefly some of the more 
significant of the points that I have made. 

There is at present a very general attitude of distrust and 
suspicion toward the objective general achievement test. This 
attitude is a major obstacle to the growth of cooperative 
regional testing programs, and to the development of their 
educational guidance and other possibilities. This lack of 
confidence in the general achievement test is due to a general 
failure to recognize and understand the specific functions and 
the technical limitations upon the content of a general achieve- 
ment test. The immediate purpose of a general achievement 
test is to rank pupils in the order of their total achievement. 
To do this most effectively and within practicable time limits 
it must be specifically adjusted in difficulty to the particular 
group for which it is intended. This means that its content 
must be restricted, within the broad limits set by curriculum 
objectives, to the actual achievements of the pupils tested. 
It follows from this that the concept of validity of content 
from the point of view of achievement testing is much more 
restricted, specific, and technical in nature than the concept 
of validity from the viewpoint of the curriculum builder. 
Certain specific implications of these facts are: 

That the content of a general achievement test cannot rep- 
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resent a cross-section of the entire course of study; that the 
process of test construction is predominantly empirical and 
technical in nature; 

That general achievement tests for general high school use 
must of necessity be largely informational in character and 
limited to a low level of understanding and of reasoning; 

That a general achievement test cannot, within practicable 
time limits, also serve effectively in the diagnosis of individual 
deficiencies ; 

And, finally, and perhaps most important, that a general 
achievement test is purely a measuring and not a teaching 
instrument, and that ideally it should be neither intended nor 
allowed to influence teaching practices. 

E. F. Linpaquist, 
University of Iowa. 





Judging and Recording Pupil 
Characteristics 


INTRODUCTION BY Mr. FREDERICK J. V. HANCOX 


I should like to express my very deep appreciation of the 
honor conferred upon the organization which I represent and 
upon myself by the invitation which the Educational Records 
Bureau and the organizations that are sponsoring this con- 
ference have given me to take some small part in it. My 
share in the activities of the conference makes me think of one 
of the characters in “Of Thee I Sing” and “Let ’Em Eat 
Cake”—the much-esteemed Vice-President. In view of the 
subject of Dr. Smith’s address, however, my inconspicuous 
part in the proceedings seems to me very satisfactory. I should 
hesitate a long time before consenting to deliver an address 
on the subject of “Character Traits and Their Rating.” (It is 
dificult enough, heaven knows, to discover the truth about 
one’s own character without attempting the enormous job of 
estimating someone else’s. ) Somehow or other this task of 
personality rating must, however, be undertaken and carried 
on. The need for some such attempt is obvious at the time of 
a pupil’s transfer from one institution to another. It is 
obvious also that work of this sort might be made tremendously 
valuable to the pupil himself in the field of self-appraisement 
and self-improvement. 

I know no man who is better qualified to deal with so intri- 
cate and delicate a subject than Dr. Smith. The three years 
during which the Secondary Education Board was at work on 
its Study of the Secondary Curriculum gave me almost un- 
limited opportunity to see Dr. Smith in action. The effect of 
that observation is that I have complete confidence in Dr. 
Smith’s ability to illuminate the subject under discussion with 
the light of reason and sympathy. 


Appress BY Dr. EUGENE R. SMITH 
MERICAN education has failed to fulfill its promise to 
civilization. Over and over again one or another of 
its leaders has stated in no uncertain terms that all that 
was needed to make all right with the world was support of 
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universal education. It was assumed that a man or woman 
of sufficient schooling was, because of that, successful as a 
person and as a citizen. 

Very little was said as to what kind of education was to be 
supported. There were few to suggest the difference between 
mere schooling and real education. People were slow to point 
out the fact that an educated criminal might succeed as a crimi- 
nal rather than as a law-abiding citizen. 

The American people have rallied to the support of educa- 
tion. They have spent sums of money that would have been 
unthought of a short time ago. The United States has at the 
present time approximately a million teachers working with 
over twenty-seven million children. It is true that we are 
faced just now with an emergency in the financial support of 
our schools, but I have enough faith in the American people’s 
belief in education to think that even in this difficult period 
they will see that educational institutions receive the support 
they need. 

The public has done its part, but education has not proved 
its case. True, these millions are not yet managing the coun- 
try, but their predecessors in our schools are, and they have 
committed crimes and made mistakes to an extent that it is 
difficult to excuse. The reason, I believe, is that teachers and 
schools have not realized fully enough their responsibility for 
character and for citizenship. Traditionally, and, I think, on 
that account quite naturally, education has been concerned 
primarily with scholarship, with the academic view of the duty 
of the school. 

Schools originally had a definitely academic purpose. It 
was their duty to teach certain subjects that were necessary 
for certain groups of people. Unfortunately they have held 
to that important but restricted aim without stopping to ana- 
lyze the changed and still changing demands on the school 
brought about by present conditions of life. 

I should dislike to be thought to be too greatly minimizing 
the value of scholarship or of academic work. I should be 
sorry to be in the position of a professor in one of our col- 
leges who, in speaking one night, outlined the aims of educa- 
tion and dared to put them in percentage form. He talked 
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about the formation of character, the development of citizen- 
ship and the cultivation of certain powers, attitudes and habits, 
and ended by leaving but ten per cent for knowledge. The 
next morning as he walked across the campus and passed a 
group of young men who were talking together, he heard one 
of them say to the others, “There goes Ten per cent Knowl- 
edge.” 

As I said, I should dislike to be in the position of seeming 
to minimize too greatly that very important aim of the schools. 
The fact remains that we have over-emphasized knowledge 
per se. We have over-emphasized stated bodies of facts and 
information. We have given too little emphasis to producing 
the right kind of people, and we have even under-emphasized 
those habits and skills that underlie all effective scholarship. 

I have thought sometimes that our educational procedure 
might be likened to the use of a cannon. We have too often 
loaded the cannon and paid no attention to the direction in 
which it was pointed. We all know that the effect of the 
explosion of a cannon that happens to be pointed in the wrong 
direction may produce quite disastrous results. Yet we have 
turned out a great many young people who had been given 
school training without sufficient assurance that they would use 
that training in a constructive way. Consequently, there has 
been no direction, no certainty that the things provided were 
going to come back to society as assets rather than liabilities. 

I am not sure that I could not press the simile one step 
further, and say that in many cases we have loaded the cannon 
with the cannon ball of solid facts, not only without aiming 
it, but even without providing for that drive that might be 
likened to the powder that would make the ball move. 

We cannot in our schools afford any longer to leave out the 
essential elements of motivation that will arouse interested 
self-activity, and the assurance that we are aiming where we 
wish the cannon ball to go. 

I am quite sure that these ideas are familiar to all here, 
and that you all realize the trend at the present time toward 
thinking in terms of the individual, of the kind of a person he 
is going to be, of his likelihood of personal success and of some 
degree of assurance that he will contribute to the community. 
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Such thinking is fundamental to the educational process, and it 
seems certain that now, to a degree that never has been true 
in the history of American education, we must, instead of drift- 
ing, face the situation and analyze and provide for the needs 
of the school and its pupils in the light of increasing educa- 
tional knowledge and of present world conditions and 
demands. 

I think it is not exaggerating to say that not only in our 
financial life, but also in the adaptation of our schools to the 
demands of civilization, we are at a turning point—we face a 
crisis. Fortunately, many of the associations that are dealing 
with young people have gone on record in recent times in no 
equivocal terms. I am going to read you a few quotations, 
some of which I am sure are familiar to you, to bring to your 
minds the importance of individual development as shown by 
the thinking of various groups. I will start with the report 
of which our Chairman has already spoken, that of the 
Secondary Education Board. I think this statement of the 
objectives of secondary education is one of the most forward- 
looking ones that has been announced: 


‘That the objectives of secondary education should include 
the mastery of the essential processes of learning and the 
establishment of constructive attitudes and habits. Through 
fundamental training and appropriate experience the develop- 
ment of the individual’s power should be directed toward: 

“1. The acquisition and preservation of good health and 
emotional balance; 

‘2. The promotion of personal morality, worthy home and 
community membership, national and world citizenship. . . . 

‘3. Increasing ability to get information, to reason accu- 
rately about it, and to express in oral and written form the 
conclusions reached; 

“4. The establishment of an adequate basis for higher edu- 
cation or individual occupation; 

‘5. The cultivation of such tastes and interests as may lead 
to the wise use of leisure.” 


This statement would not have been made in such a form 
even a very few years ago. While it was made by a group 
representing primarily what are called the preparatory schools 
of the country, it very definitely indicates preparation for life 
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rather than only for further scholarship. It sets an aim in 
terms of personal powers and social adjustments. 

The Report of the School and College Relations Committee 
of the Educational Records Bureau makes this brief but, I 
think, rather comprehensive statement, dealing particularly of 
course in terms of college preparation: 


“Information regarding the personality development of 


pupils is of the greatest importance to schools and colleges 
because: 


‘1. Assuming adequate intellectual capacity, habits and 
attitudes outweigh any other factors in determining success or 
failure in schooling as well as in life. 


“2. As complete knowledge of personal characteristics as 
can be obtained is essential in any plan of guidance. 

“3. Failure to emphasize habits and attitudes results in 
unwise overstress on subjects and academic success.” 


Its first recommendation made to the colleges was “‘that 
colleges emphasize much more strongly the importance of 
information concerning personal characteristics as a criterion 
for judging candidates, and shall therefore encourage the study 
by schools of the traits, habits and attitudes of their pupils, 
the recording of such information in suitable form, and the 
submission of more complete and objective information as a 
part of the entrance requirements.” 

This committee’s recommendations have gone to all of the 
colleges of the country and that particular recommendation 
has been almost universally approved by the colleges. 

The American Council on Education has shown a great deal 
of interest in this field. It has had its Personnel Committee, 
as well as a committee of scientists that has been attempting 
to find out which are the most fundamental traits of human 
beings. The name of that committee is in rather difficult 
terms—‘Unitary Differential Traits.” No one knows yet how 
well it is going to succeed in finding such traits. The last time 
I heard the chairman speak of it, he said that as far as he 
could tell now there might be no differential traits, and if there 
were, they might not be unitary. At any rate, investigation 
is likely to give more definite knowledge as to which are the 
least and the most complicated of human traits. 
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A great deal has been done on the study of emotions, some 
of this also being under the direction of the American Council 
on Education. This work is not, however, advanced enough 
to do more than indicate the need and possibilities of this field. 

i The Progressive Education Association, through its Com- 
/ mission on School and College Relations, has shown its interest 
by the statements in the eight-year plan proposal. One of 
the principal aims of this investigation is stated as ‘‘Clearer 
Understanding of the Problems of our Civilization, and the 
Development of a Sense of Social Responsibility.” Another 
has only the brief heading, ‘Guidance of Students,”’ but under 
that guidance is included everything that we are discussing. 

The degree to which individual institutions, schools, col- 
leges and social agencies are thinking of this matter may be 
judged from the fact that when the Reports and Records 
Committee began to study the headings used either in giving 
or in getting information, it found over one hundred and fifty 
different characteristics listed. It is very difficult to say which 
are attitudes, which are habits and which are traits of other 
kinds. Therefore, in discussing them I shall not try to be 
too specific or too scientific in my use of such terms. 

These one hundred and fifty headings had to do with types 
of personalities and the development of various powers and 
attributes. Many of the headings, of course, were dupli- 
cates, and some of them were not well chosen. The impor- 
tant fact, however, is that enough colleges, schools and other 
agencies were studying young people so that they had found 
this large number of headings about which they wished to be 
informed. 

One difficulty in carrying out any scheme for finding the 
answer to questions in relation to these various characteristics 
is the tremendous intricacy of human nature and the conse- 
quent difficulty of analyzing an individual’s development. 
Tests in this field are difficult to develop and have made only 
moderate progress, though the work of such men as Harts- 
horne and May deserves mention. Questionnaires have also 
been developed, which are to be answered by young people 
themselves. Through their large numbers of questions there 
is eventually worked out a map of the answerer’s thinking, 
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emotional responses and likely behavior in different situations. 
In addition there are methods for the study of children by 
parents, teachers, or other observers, who record those things 
that seem to have significance in regard to the kind of persons 
the children are. Of these methods, teacher ratings of some 
controlled kind seem likely, for some time at least, to be the 
chief dependence of those trying to learn more about children. 

More progress has been made in this field with young chil- 
dren than with older people. One of the reasons is that 
young children live with one person in our schools in such an 
intimate way that that one person has the opportunity of 
knowing them very well. Consequently, when such a person 
records the facts, with all that concerns the various children, 
there is eventually built up a reasonably clear picture of the 
kind of person each child is. 

Various difficulties have arisen, however, in this kind of 
work. Unfortunately the persistence of the “marking’’ idea 
that has so dominated schools in academic fields has carried 
over to personality studies, so that teacher ratings on such a 
trait as honesty have been comparative rather than descriptive. 
This might not be serious if honesty were a single habit or a 
trait uninfluenced by circumstances. However, people differ 
in their honesty in truth telling, in regard to taking advantage 
in games or other situations, and in regard to property. Con- 
sequently a comparative rating is so indefinite in its application 
that it provides little that has analytical value. 

‘To serve their purpose fully teachers’ judgments should be 
as descriptive as possible, and the description should be based, 
to as great a degree as possible, on observed occurrences. It 
is only in this way that one can avoid too subjective an 
approach, and can obtain results that are likely to be valid. 

Again, teachers have not always known what to observe. 
One might think that all teachers would have the same con- 
ception of what was essential, of what they should observe, 
but this is not true. Teachers have had neither a well-under- 
stood and organized purpose in observing nor a common lan- 
guage in recording. I suppose we shall never reach a time 
when we all will use words with the same shades of meaning, 
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but the present degree of difference in teachers’ recording has 
proven a very serious handicap. 

There has also been great difficulty in finding ways whereby 
teachers could keep records of the things they observed and 
the indications shown. I know of some schools where teach- 
ers have carried pads with them, so that the moment anything 
happened they could make a note of it, as that Jane had 
quarreled with Mary about this thing or that. On account 
of such difficulties there have been various attempts to find 
out what is most important, and to give teachers a somewhat 
common technique and language for use in child study. 

One of the most successful of these attempts for younger 
pupils takes as different headings those things that teachers 
can well study about the pupils and then points out to the 
teachers what seems essential enough to be worth recording. 
I shall read you as a sample one column heading under the 
general topic, “Habit Formation.” This uses no classifica- 
tions; it has only the intent of guiding the teachers in their 
thinking: 


“T. Work Habits: 
1. Attention 
2. Care and Neatness 
3. Work Tempo 
4. Industry 
(a) Individual Work 
(b) Group Work 
5. Concentration and Persistence 
6. Self-dependence 


“II. Use of Time: 
1. Prescribed Situations 
2. Free Choice Situations 
(a) Unassigned Periods 
(b) Assigned Periods 


Similar analyses are made to help judgments in relation to 
various heads under mastery of skills and knowledges, social 
and moral development, and the formation of certain habits. 

The value of this kind of guidance for teachers lies in the 
fact that all the teachers analyze their pupils under this head- 
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ing and its divisions, writing full paragraphs, perhaps quoting 
occurrences that will illustrate various points. Consequently 
they will think in terms of certain desirable aims, they will 
be guided in their observance of their pupils, and they will 
have more nearly the same understanding concerning the per- 
sonality development that is being discussed. 

This is excellent where one teacher lives with one group of 
children, so that she knows the children well, and has the 
opportunity and the time for recording information about 
them. It becomes more difficult with a larger class, but it 
remains possible for one teacher, even with quite a large group. 
The whole picture changes, however, when a number of special- 
ists meet children of one group, and also teach other groups, 
as is usual in American secondary schools. The specialist has 
a much heavier pupil load, he meets more children and has 
less time for recording, even less time for studying the chil- 
dren. Consequently an attempt to make such detailed analyses 
written out in paragraph form would add at the present time 


a burden that probably would be unbearable to the teachers. / 
I hope some day we may reach the ideal that was stated by > 


Dr. Morrison of Chicago University in some such words as 
these: “that teachers of the future would spend half time 
studying the pupils and the other half doing the things this 
study showed to be necessary.” I am not certain about this 
division of time, but I quite agree with the idea that if one 
could put a considerable portion of his time on definite study 
of young people and then could carry out the things that 
study showed to be necessary, we should be approaching a 
millennium in our school work. 

It is necessary, however, when we use specialists, to do 
something quite different from what is possible with young 
children. It is just as necessary that we shall pick out the 
information that is essential for understanding the pupils. (It 
is much more necessary that we shall find a short-hand method 
of recording, that we shall find a way by which busy teachers 
can make a usable record of important information about 
their pupils, which they can use themselves and can pass on 
to others for their use. 

There are a number of important criteria for choosing the 
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particular topics under which teachers shall study their chil- 
dren. It is important in the first place that headings shall be 
chosen about which teachers can speak with some authority, 
characteristics they can observe in the conduct of their chil- 
dren and that therefore have reality to them. Otherwise we 
commit the absurdity of asking teachers to judge something 
which they have no opportunity to observe adequately. The 
first criterion, therefore, and an essential one, is that any 
heading used shall be one about which teachers can make 
judgments based on observed evidence. 

The second is that the facts obtained shall be valuable. 
For what? I think, first of all, for immediate use; that is, 
that it shall be guidance material that will suggest something 
to do about helping a particular pupil to make the most of 
himself, both individually and socially. Undoubtedly the mate- 
rial should have great value in helping to guide the pupil in 
his decision as to what he will do after leaving school, whether 
this means immediate further schooling, entrance into indus- 
try or some other procedure. One use that will at once come 
to our minds is for college entrance information, where it 
ought to have value second to no other obtainable informa- 
tion about the pupils. It should also have importance in 
guidance in after-school years whether in college or out. It 
ought to be in such form that college officers, particularly per- 
sonnel officers, can get from it much that is essential in know- 
ing how to deal with students, and it ought to have value in 
the same way for employers, for employers must sooner or 
later realize that it pays them to take responsibility as guidance 
officers. In fact, I see no escape from this kind of responsi- 
bility in our coming organization of society. 

Ideally more important even than these specific and essen- 
tial criteria is the possibility of helping, by designating and 
analyzing certain human attributes for study and recording, 
to establish aims and emphases that will give direction to 
schooling, that will make education function as continuing 
guidance in the after lives of American children. 

If there can be set up well-considered and clearly defined 
aims in terms of habits, attitudes and traits that can be influ- 
enced in school years, the resulting effect should be to make 
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the great purpose of the school that of developing the best 
kind of people its pupils can become, not by any negative or 
puritanical basis of judgment, but as evidenced by their approx- 
imation to their own highest development, and by their atti- 
tudes and behavior toward human society. It may even be 
that such definition of desirable goals may become a recog- 
nized challenge to youth itself, an established ideal of what a 
community expects from those who compose it. Part of 
youth’s difficulty today can be traced to the fact that it recog- 
nizes no certainty of ideals, no agreement on standards in 
adult thinking. 

A very interesting attempt is being made by the Reports 
and Records Committee working under the Commission of 
the Progressive Education Association. /This committee is 
attempting to find the headings that fit the criteria of which 
I have spoken, and to devise means by which teachers, with- 
out too much expenditure of time, can present pictures of the 
various pupils with whom they deal. This is really only an 
extension of a number of less complete attempts that have 
been worked on by investigators. One of the most common 
methods, and one of the most successful attempts to record 
facts about pupils’ responses in various attributes, has required 
the rating of pupils along a line on which there were keyed 
points. In this method as a certain point meant one type of 
child, and a different point another type, one could, by making 
his own placement, give someone else an idea of what was 
thought about that particular pupil in that particular trait. 
The old idea of subject marking as a comparative rating car- 
ries over so easily that there is always in this method the 
likelihood that teachers will think very largely in terms of 
comparisons rather than descriptions, even though they are 
dealing with personalities. Another difficulty is that indicating 
points only by a word or short phrase has not sufficiently 
defined to teachers exactly what type of person was being 
described. It has not been exactly clear to any one what was 
meant by the markings that were made. 

In order to help teachers to think more objectively and more 
consistently the committee of which I spoke has made pre- 
liminary classifications in ten traits, habits and developments 
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of power, and in each case has defined five types as its classifi- 
cations. Undoubtedly the classifications carry a certain con- 
notation of excellence. It is possible to compare, but the 
emphasis is on description. The intent is to predict what kind 
of a response can be expected of a particular pupil because of 
past experiences with him. The teacher is supposed to base 
judgment on objective evidence; not on ““‘What do I have an 
impression this particular pupil is?” but on ‘What has this 
pupil done in various situations that leads me to believe that 
he is of a certain general type, or that he has reached a certain 
stage of development ?” 

This may sound somewhat vague or even impossible. It is, 
I believe, neither vague nor impossible. It has already been 
amply demonstrated that it is quite possible to know and 
describe different people in particular traits, so that those 
people can be readily distinguished. There will undoubtedly 
be some difficulty in putting any such method into completely 
general operation because of the inertia or opposition of some 
teachers. However, similar methods have been in successful 
use in scattered places for many years, and a group of about 
one hundred teachers who have just been experimenting with 
such a system have, on the whole, been very responsive and 
very much impressed by its possibilities. Occasionally there 
is one who reverts to the stage of believing more in unguided 
judgment than in any kind of assisted and verified judgments. 
This attitude can hardly be widespread nor can it persist in 
the face of the evidence on the other side. Granting that 
some teachers might be able to write extended essay type 
descriptions of pupils that would be vivid and accurate, never- 
theless such a plan is not feasible for the purposes defined. 

This cannot be adequately done by all the teachers dealing 
with a group of pupils under the usual conditions of American 
secondary schools because of limitations of time, of aware- 
ness to what is most important, and of ability to write such 
a description. If it is done by some only, the picture will 
naturally be incomplete. Even if all had the time and ability 
to do this, unless their attention was called to the particular 
information deemed most important, the reports would be so 
incomplete as to greatly lessen their value for any of the speci- 
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fied purposes. There would be little common understanding 
of the terms used, or the implications carried. The informa- 
tion would be too bulky for easy access to essential facts, and 
it would, when carried over a term of years for a particular 
pupil, lack the great value of that easy comparability over a 
long term which is so essential to the study of trends. 

No teacher can afford to be so sure of his unguided judg- 
ment that he is willing to ignore attempts to give that judgment 
objectivity and comparability, and to make it understandable 
and valuable to others because of use of a language they will 
understand and of criteria that are commonly agreed upon. 

The Reports and Records Committee, starting from the 
one hundred and fifty headings, has made a preliminary list 
that includes the list of ten of which I have spoken. The 
first step in the selection of traits was a subjective but never- 
theless an analytical one. The committee started by grouping 
together those trait names that seemed to mean much the 
same thing. For instance, there might be six words that 
seemed to be so nearly alike that the best word of the six could 
be chosen because it would fulfill all that the various institu- 
tions needed. The directors of college admissions who were 
on the committee decided whether knowledge concerning par- 
ticular traits seemed to them important information for accept- 
ing or refusing candidates to college or for college guidance. 
Those working in the schools were asked to what extent 
knowledge about such traits would be of value for guidance, 
and whether teachers could judge concerning them. The com- 
mittee tried to get every viewpoint that might result from 
studying or using studies of traits of various kinds. One head- 
ing after another either was absorbed into one of the few 
major groupings, or it proved to have some objection to its 
use that made its retention inadvisable, or else it seemed not 
to be usable for the purposes decided upon. In this way, over a 
considerable period of time, the list of traits was formulated. 

After this the committee was ready for the next step, which 
included a scientific study of its results. About one hundred 
teachers in various schools were asked to classify pupils, using 
the types and definitions that had been made by the committee. 
The results of that study, and the suggestions and criticisms 
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of the teachers will be used in a restudy of the list of traits 
and their sub-types. 

The present list includes ability to obtain information from 
sources other than reading, attitude to one’s responsibilities: 
dependability, creativeness and imagination, influence, inquir- 
ing mind, openmindedness, perseverance, the power and habit 
of analysis; the habit of reaching conclusions on the basis of 
valid evidence, reading ability, standards of accomplishment 
(or urge to do one’s best), energy or vitality, emotional re- 
sponse and emotional stability, thoughtfulness or the habit 
of reflection, integrity, moral courage and personal relation- 
ships. The last one may be subdivided to include personal 
acceptability in a group, and general attitude toward group 
living. 

It is the committee’s belief that some of these human 
attributes can best be dealt with by defining common types 
into which pupils are likely to fit, that for others some defined 
word or phrase may prove most descriptive, while in still 
others there may prove necessary a short paragraph describ- 
ing any unusual response. A comprehensive manual of direc- 
tions must of course be prepared. 

The first ten characteristics have now been analyzed into 
types, though the results are not considered final. 

As an example of the type definition method I will give the 
committee’s analysis of “Attitude to One’s Responsibilities: 
Dependability.” This note precedes the type definitions: 


“While this classification depends largely on attitude toward 
one’s duties and opportunities, the demonstration of the atti- 
tude in actual practice is the objective evidence on which one’s 
placement depends. Unusual devotion to a particular under- 
taking by one not in general highly developed in this attitude 
should be noted separately.” 


“The First Type: Those who are dependable in carrying out what- 
ever is undertaken. They do not confine their efforts to what is 
assigned to them by others, but also develop an absorption through 
active initiative and interest that results in their carrying on unre- 
quired investigation or other work for which they see need or in 
which they see value.” 


I think you will at once recognize this rather unusual type 
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of person. It is unfortunate that there are not more of them, 
and it is very important that they all be recognized when they 
do exist. There is a note under this type saying that this 
attitude might be shown either in connection with school work 
or with pupil activities. There are also examples of different 
ways in which pupils might show this particular type of 
response and dependability. I might say that it is the purpose 
of the committee to add greatly to its list of illustrations, for 
it wishes to do everything that can be done to make the 
teachers’ judgments as well founded as possible. 


“The Second Type: Those who are dependable and conscientious 
in doing what is required of them, performing their duties without 
the need of any compulsion from others.” 


This is also a very important class of people. It lacks the 
extra flair that is in the first group that carries them beyond 
what others may suggest, that makes them do the thing the 
teacher hasn’t asked for. It is very fortunate if a large per- 
centage of our population falls even in the second group. 


“The Third Type: Those who have the general intention of per- 
forming their duties conscientiously, but fail in carrying out this 
intention often enough so that others are forced to assume some 
responsibility for them.” 


There is a note under this that such pupils usually prepare 
their work or carry their other responsibilities, but occasion- 
ally need reminding or are open to criticism in regard to care- 
less or incomplete work whether in classroom or in other 
activities. 


“The Fourth Type: Those who are decidedly irregular in their 
attention and application, so that others must carry the respon- 
sibility for their work.” 


The note under this says that a teacher is forced to apply 
more or less continuous pressure to obtain results at all con- 
sistent with the ability of such a pupil, and that others must 
supplement his contribution to an activity in which he is en- 
gaged. 


“The Fifth Type: Those who will not or cannot hold themselves 
to their work even with an undue amount of help.” 
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The note here is that such a pupil requires immediate in- 
vestigation of the reason for such a serious condition. 

I think this will give some understanding of what I mean 
by the attempt to provide the teacher with a shorthand method 
of recording. Here are five types. They are not absolutely 
exclusive. Unquestionably, they do not include every type of 
person that exists. They do nevertheless fairly well indicate 
the most common types that occur in our schools in relation 
to this particular trait. 

Consequently, in place of a teacher’s trying to write at 
length about the dependability of a certain pupil, that teacher, 
when accustomed to the use of this set of definitions, can 
simply indicate, perhaps by a number only, the most common 
type of response of the pupil. If the teacher uses several other 
headings analyzed in the same way, it becomes possible, by 
recording a few keyed letters or numbers, to indicate types of 
responses for the person in a number of traits and therefore 
to give an important part of the description of that personality. 

You may say, “This teacher has the boy in English; that 
teacher has him in mathematics. The results may be totally 
different in those two fields.” It isn’t only similarities in the 
pictures given by different teachers,—it is differences as well 
that are significant. If there is a general consensus of opinion 
about some one thing, this probably indicates a fact that is 
true about that child, but if you find a pupil who responds here 
and doesn’t respond there, that in itself has significance and 
it is also a reason for further study. The cause may relate 
to the pupil’s response to subject fields, it may be a matter of 
the personalities of the child and the teacher, or there may be 
some other influences that bring it about. 

But suppose there is accumulated over some years a study 
by every teacher who has had the opportunity to know a 
certain pupil. It is evident that the similarities or differences 
in judgments will gradually build themselves up if they have 
importance or iron themselves out if they are not real. There 
will be evident certain very definite tendencies that will be 
shown by an accumulation of facts about the pupil. There will 
be other evidence that seems to be irrelevant or inconsistent 
and therefore needs study for its explanation. 
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The important point is that the analyses of all the teachers 
in one year, with the help of the other facts known by the 
school, will give a picture of the pupil’s stage of development 
at that time. A similar picture will be made the next year 
and again the next, so that there is obtained cumulative evi- 
dence of growth or lack of it in the most essential traits. 
Marked changes may occur during a school year, and there 
will be provision for showing that fact. 

There will unquestionably be many pupils who cannot be 
put into any common classifications. Such extreme variations 
will be indicated by notes. 

There may be vital facts that synthesize the other informa- 
tion and make a living human being out of what might other- 
wise be only Bertillon measurements of personality, and there 
must therefore be a place for the recording of such additional 
information. 

The committee has no intention of excluding any facts or 
judgments that may have significance. It hopes to make it 
easy to judge and record some commonly accepted funda- 
mentals, to make them easy of access and understanding for 
further study and use, and to emphasize the importance of 
the cumulative feature of such studies. 

Behind any such picture as a teacher may make, there must 
be untold study of the pupil day after day, consciousness of 
the fact that it is the kind of person that is being made that 
is the essential test of education. That can never be avoided, 
and I am not ready to apologize to any one for any amount 
of time that a teacher may find it necessary to spend on the 
analysis of the possibilities and needs of his pupils. It does 
seem very important that the recording shall not take so much 
time that it hinders such study or the corrective work based 
on it. (The recording machinery therefore must be as simple 
as possible, which fact, I repeat, is an important reason for 
the type form of classification.) 

It is the committee’s hope then that when its list of atti- 
tudes, habits and traits is tested and complete, when its defini- 
tions of types and its other provisions for judging and record- 
ing facts concerning a pupil’s characteristics are ready for use, 
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there will have been developed the most complete way in 
which a teacher, by a shorthand method that requires the least 
possible use of time, can record whatever he knows about a 
pupil and can pass it on to any one else who is familiar with 
this method of studying children, in such form that the other 
person will know what is meant.) I can foresee the time when 
all the schools and colleges of the country will be talking the 
same language when they discuss those things that have to do 
with personality either in relation to college entrance or to 
that more important goal of intelligent pupil development 
and guidance. 

I believe that such a system as this will make it possible for 
a school to bring out the salient facts for the use of college 
admissions officers in a way that has behind it not unsupported 
opinion, but carefully recorded judgments based on objective 
evidence, on observation of actual responses and happenings. 
I believe therefore that for college admissions officers alone 
it will have tremendous value. 

Yet I am not nearly as much interested in that as I am in 
the fact that it furnishes material for immediate school use. 

I started by saying that American education had failed to 
fulfill its promise. I believe this characteristic study is the 
first step toward making it possible for it to fulfill its promise. 
You all know H. G. Well’s statement concerning the “race 
between Catastrophe and Education,” and very likely his later 
comment that education had given up the race. Education 
hasn’t given up the race. Education is using the spurs. Its 
first gain will come through better understanding of its human 
material, its needs and tendencies. 

We are now using scholastic aptitude tests to find out the 
mental quality of our pupils. We are using various kinds of 
comparable tests to determine the degree of power and mas- 
tery obtained in various subject fields. We cannot accomplish 
what must be done unless we complete the picture, unless we 
find out about the pupils’ attitudes, their habits, their char- 
acter traits, and determine what is necessary to make these 
constructive. The first step is the analysis. I have no time 
today, and it is not in the scope of my paper to discuss what 
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ought to be done after one has made the analysis, but of 
course every one of us knows that the test will come then. 
The success of remedial work will be the real proof of the 
practicality of anything done in studying young people, but 
one cannot use the remedy until the diagnosis has been made. 
However, even though nothing came out of such a study as 
this beyond an emphasis in the minds of every teacher on the 
importance of the kind of person who is to come out of the 
school, if only we all came to realize that the essential aim was 
a person faced in the right direction, even then I think you 
will admit that such a study would have justified itself. 

But I am sure we are going further than that. I am sure 
we are making a long step toward giving an accurate diagnosis 
to the degree to which our present knowledge makes it pos- 
sible. I believe that on this we can build sound, remedial 
practices so that we shall, with every child, in every one of our 
schools, eventually say, ‘““What does this pupil need today? 
What is indicated by the information we have in hand as the 
necessary next step in his development?’ And then we shall 
try to give it to him. If that day comes, if we find we can 
make these studies, record them in usable form, and take the 
next steps in remedying those things that need remedying, and 
in offering those opportunities that are shown to be desirable, 
we shall then be able to face civilization, and say, “Yes, we 
have added to our education Direction. We are not just turn- 
ing out people who have powers and skills and knowledges, 
without knowing how they are going to use them. We are 
trying to see that they set their faces toward the future, that 
they are trying to make the most of themselves, that they real- 
ize their privilege and duty to make the greatest contribution 
possible to their fellowmen.” 

EUGENE RANDOLPH SMITH, 
Beaver Country Day School, 
Chestnut Hill, Mass. 
















Measurement in Educational 
Experimentation’ 


INTRODUCTION BY Dr. BEN D. Woop 


This morning we have the privilege of hearing Dean Mc- 
Conn. He has been one of the severest critics of the testing 
movement that we have had and one of its most devoted and 
helpful friends. In fact, you can tell, often, what side of the 
controversy Dean McConn favors by the severity with which 
he criticizes it. He has also been known to find fault with 
the progressives, and I therefore can assure you that he is 


their friend. It gives me great pleasure to present Dean 
McConn. 


ADDRESS OF DEAN Max McConn 


HE title of this paper has been carefully composed so as 

to look and sound decorously drab and unexciting. This 

has been done in accordance with that code of etiquette 
which proscribes any semblance of human interest in the titles 
of addresses at educational meetings. 

As a matter of fact, however, the real topic which my title 
so punctiliously drapes is a distinctly controversial one. 

The nature of the controversy may be indicated by refer- 
ence to the four groups sponsoring this ‘Second Educational 
Conference,” as listed on the first page of our program. You 
have all scanned that list. It includes (1) the American Coun- 
cil on Education Committees on Personnel Methods and on 
Educational Testing, (2) the Cooperative Test Service, (3) 
the Educational Records Bureau,and (4) the Progressive Edu- 
cation Association’s Commission on the Relation of School and 
College. It will be noted at once that the first three of those 
groups are concerned, not solely, of course, nor ultimately, but 
directly and immediately, with testing and measurement and 
records; whereas the fourth group, the Commission of the 


1Presented at the Third Annual Meeting of Institutional Members of the 
Educational Records Bureau, New York City, November 3, 1933. 
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Progressive Education Association, has much wider objec- 
tives, among which testing and measurement and records may 
be regarded as playing only a very minor and incidental role. 

It might be expected that some difference of attitude and 
emphasis and point of view would develop among partners 
thus assorted, and it is a fact that such difference has actually 
developed to a point which I fear fully justifies the word “con- 
troversy.” As a controversy it has so far been kept for the 
most part under cover, in the form of doubts and reservations 
and smouldering suspicions, freely and fervently expressed 
by the members of each party among themselves, but not as 
yet flung openly in each other’s teeth. 

But this stage could not last much longer, and in any case 
it is not a happy or healthy situation. Accordingly, it is the 
purpose of this paper to drag this controversy forth into the 
light of day, to air it somewhat thoroughly, and quite possibly 
to give occasion for a still more thorough airing at the dis- 
cussion session this afternoon. 


Il 


The dragging forth process I hope to accomplish by stat- 
ing in turn, as well as I can, the two opposing points of 
view; and, here at the beginning, I shail endeavor to present 
each side with some of that exaggeration and heat and bias in 
which the proponents of each are inclined to indulge in their 
private “bull sessions’ together. Because, in this case as in 
many others, the exaggeration and heat and bias are essential 
parts of the controversy. Perhaps, in fact, it may turn out 
that those aspects of the matter represent the major part of 
the difference. 

First, then, let me try to set forth the doubts and question- 
ings of those devotees of tests and measurement who are just 
now looking somewhat askance at the project of the Progres- 
sive Education Association. They are inclined to say that 
the progressives don’t really know what they want to do or 
how they want to do it, that they have not been able to agree 
on any common curriculum or common subject matter, and 
that, since they appear to be unwilling to have their results 
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measured by any standardized and comparable tests, neither 
they nor anybody else will know, when they get through, what, 
if anything, they have accomplished or demonstrated. One 
lively correspondent of mine has expressed it thus: that their 
whole project seems likely to degenerate into “a disjointed 
series of spasms on the part of individual schools and bolshe- 
vistic individual teachers, without any common or understand- 
able measuring rod being applied to any two of the institutions 
or classes.” 

Perhaps that may serve for that side. Now for the retort 
of the more radical progressives. 

They are wont to declare—these more radical progres- 
sives—that the existing tests are no good. Or, in milder mood, 
they may assert merely that they are “inadequate’—which, 
however, means, I take it, much the same thing. More spe- 
cifically, they claim that the existing tests measure only mere 
information, mere facts. 

You will all recall that Miss Daisy Ashford in The Young 
Visitors described certain persons as being “very mere.” That 
is the way some of the progressives apparently regard infor- 
mation and facts; they practically never refer to them without 
calling them “mere.” But this is a digression. To continue: 

The members of this group assert that they are very little 
interested in information, facts—whether “mere” or other- 
wise—that what they are concerned with in their students is 
such things as growth and power, attitudes, understandings, 
appreciations, and the like, and that the existing tests do not 
measure any of these things, and therefore are of no sub- 
stantial use. 

And then, by way of counter-offensive, carrying the war into 
the enemy’s country, they are likely to claim that any existing 
test or group of tests, if it is known that it is to be used, will 
inevitably become a goal of instruction, will be prepared for, 
“crammed” for, so that the pupils may make a good showing, 
and will thus come to dominate the curriculum and the subject 
matter of individual courses and the methods of teaching, and 
consequently will check free experimentation and kill spon- 
taneity and stifle and devitalize the whole business. If we are 
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to have tests, they say, why not go on as we were, with the 
College Board Examinations? Why should we go to great 
trouble to set up a so-called experiment if we are merely to 
exchange our old shackles for new ones which may be equally 
galling? 

This, you will see, comes close to being the exact opposite 
of the position taken by the more conservative testers. And 
so we have the setting for a very pretty quarrel, or, to speak 
soberly, a somewhat ugly quarrel, which, if it develops, may 
do substantial damage to both causes, that of educational test- 
ing and measurement and that of progressive education. 


III 


So let us examine these two opposing positions, which I have 
deliberately stated above with some exaggeration and bias, 
as I proposed at the beginning to do—but certainly with no 
more of these attributes than I, and most of you, have actually 
seen and heard exhibited in conversations among the extremists 
on both sides; let us examine the two positions, as calmly as 
we can, to see if we may be able to strip away the exaggera- 
tion and bias and find what remains on each side that is valid 
and significant. If we should be successful in doing only that, 
we should make a substantial contribution to both causes. 

But, as a matter of fact, I propose also to suggest in my 
conclusion what seems to me a possible synthesis, a method of 
procedure in testing in educational experimentation which may 
solve the apparent dilemma—may satisfy those who are chiefly 
interested for the present in educational measurement, and 
yet may be acceptable to the most freedom-loving and experi- 
mental progressives. 

This, of course, is a large order, and my proposed synthesis 
may draw only brickbats in the discusion this afternoon. But 
even so my temerity may stimulate some more successful con- 
ciliator and synthesizer to follow either this afternoon or later. 

Since I have several times used the somewhat ugly word 
“bias,” it may be only proper at this point for me to take time 
out for a couple of minutes to give you what the astronomers 
would call my own “‘personal equation,” my own bias and preju- 
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dice. Looking at myself as objectively as I can, I should say that 
in this matter I am that despicable and unhappy creature, a mid- 
dle-of-the-road man—who can, of course, expect sympathy and 
support from neither side. I am like Mr. Snell of the Rain- 
bow Inn in Silas Marner, inclined to cry, ‘You're both right 
and both wrong; the truth lies atween you.”’ More specifically : 
I am deeply interested in educational tests; of the technical 
side of these instruments I know substantially nothing; but as 
a personnel officer, a counselor of college students, I make 
daily use of test results, and I am thoroughly convinced that 
with the help of these results I am able to do my work with 
much better success than I was able to attain before such aids 
became available. On the other hand, I subscribe with equal 
conviction to the progressive doctrines of interest and individ- 
ualization; indeed I agree with the progressives even in regard 
to the “‘mereness’’ of information; I too have little use for 
facts in education except as they may contribute to worth- 
while understandings and attitudes and appreciations; and I 
deplore as strongly as anyone any domination and standardiza- 
tion of curriculum or methods by any testing or measurement 
program. In short, it is—of course—exactly my own preju- 
dice and bias that lead me to attempt, in my own thinking, to 
synthesize the two movements and conserve the values I seem 
to see in both. 

With that out of the way, let us turn now to the position of 
those measurement people who are distrustful of the progres- 
sive program. 

When those people say that the progressives do not know 
what they want to do or how they want to do it, I disagree 
with them entirely. What those people should say in this 
connection is that they don’t understand what the progressives 
want to do or how. The progressives themselves have, as a 
matter of fact, attained a quite remarkable unanimity on these 
points. 

The proof of this assertion, for me, lies in the proceedings 
at the conference held in Atlantic City last March by that 
Commission of the Progressive Education Association, which 
is one of the sponsoring groups for these meetings. The pur- 
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pose of that conference was the final selection, by the Commis- 
sion and its Directing Committee, of the twenty-odd secondary 
schools to participate in the current project for progressive 
experimentation at the secondary level; and the selection was 
to be based, in the main, on the plans for experimentation 
to be presented there by the representatives of nearly fifty 
schools. Please note that these plans were entirely devised 
and formulated by the faculties of the different schools, work- 
ing separately and independently; the Commission having 
laid down no specifications and in fact offered no suggestions. 
Yet the many plans presented exhibited the most remarkable 
homogeneity, not only of purpose and general direction and 
general pattern, but in concrete proposals for the organiza- 
tion of curricula, subject-matter content, subject-matter group- 
ing, and teaching methods. Before I was privileged to attend 
that conference I too sometimes wondered whether we pro- 
gressives represented anything more than a congeries of 
assorted bolsheviks; but since that conference I am convinced 
that it is the progressives who do know what they want to 
do and why and how. In these days it is rather the conserva- 
tives who have no answers to such questions; else why, in the 
face of revolutionary change, should they continue to do only 
what has always been done in the past? 

But when the measurement people go on to say that if the 
progressives will not have their results measured by standard- 
ized and comparable tests neither they nor anybody else will 
know, when they get through, what, if anything, they have 
accomplished and shown, then my sympathy and conviction 
swerve sharply to their side. On this point they seem to me 
indisputably right. The Progressive Education Association’s 
Commission constantly refer to their project as an experiment. 
It is as an experiment that it has been accepted by more than 
two hundred and fifty colleges. It is as an experiment that it 
has been supported financially through the Carnegie Foundation 
and the Carnegie Corporation, and as an experiment that it has 
attracted the interest of the general educational public. And 
the word “experiment,” drawn from the vocabulary of the 
exact sciences, unquestionably implies a procedure that shall 








112 THE EDUCATIONAL RECORD 


be watched and checked and measured with all possible pre- 
cision, and shall yield results expressed as far as possible in 
exact, quantitative, comparable terms. 

It seems to me perfectly clear, therefore, that if this pro- 
gressive project is to retain, during its progress, the support 
of the colleges and of the Foundations and the interest of the 
educational public, it must call to its aid every available kind 
of measurement. And that it must do this also if its final 
report, when the project is concluded in 1944, is to have any 
wide effect on secondary education in this country or on the 
attitude of the colleges towards progressive schools or pro- 
gressive procedures in schools. Neither the schools in general 
nor the colleges will take much stock in generalized claims of 
achievement or personal qualitative appraisals; but they can 
be convinced, even against their prejudices, by comparable 
measurements. 


IV 


But it is time now to listen again to the caveats of the more 
radical progressives against what they usually style “the exist- 
ing tests.” 

I have quoted them as declaring that all the existing tests 
are “inadequate.” Well, if by that they mean, as I think 
they do, that no existing test or group of tests can measure 
the attainment of the more general, long-term goals of 
the educative process—such goals as the progressives sug- 
gest, without precise definition, when they use such words as 
“power” and “‘understandings” and “attitudes” and “appreci- 
ations’’—then I agree absolutely, and I have yet to encounter 
the most rabid tester who does not also agree. So we may 
concede that much. 

But the same people go on to make their charge more spe- 
cific by saying that the existing tests test only for information, 
facts. With that assertion I am not prepared to concur quite 
so fully. Let us agree that it is partly true, perhaps even 
largely true. But certainly the measurement people are con- 
sciously attacking this deficiency with both vigor and inge- 
nuity. You will listen at one o’clock this afternoon to Dr. 
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Lindquist of the University of Iowa on “The Technique of 
Constructing Tests in Relation to Various Uses of Test 
Results.” I presume, and hope, that he will mention, at least in 
passing, the fact that for several years now the Iowa Achieve- 
ment Tests have been constructed with the deliberate purpose 
to defeat rote learning and mechanical drill procedures. As I 
have written elsewhere’ of these tests: ““The questions used 
regularly demand, not mere facts—names, dates, definitions, 
formulae, laws—but the interpretation of facts by the recog- 
nition of relationships, sequences, causes, results, implications, 
contradictions, and the like.” Of course I mention these lowa 
tests as one example only of what all the testers are now 
striving to do. How well they have thus far succeeded in 
this effort I am not competent to judge; but in view of their 
truly remarkable achievements in general during the brief 
quarter-century they have been at work, I have a good deal 
of faith that they will advance, slowly perhaps, but surely, 
into this difficult terrain. 

But of course the radical progressive objectors do not believe 
that, as yet, the testers have made any worth-while prog- 
ress in this respect. So far, they say, all the tests are 
information tests, pure and simple. So be it! I do not myself 
think they are quite right when they say that—I think they 
are a little behind the times—but for the sake of argument 
let us grant that it is so. What then? It does not seem to 
me to follow that even mere information tests are of no value 
to progressives. It seems to me that admittedly factual tests 
can be of the greatest utility in the indirect measurement of 
the kinds of achievement to which the progressives aspire. 

Let me pause to point out that the minute we leave the 
exact sciences, physics and chemistry, we leave behind for the 
most part the possibility of direct testing and measurement. 
In geology and astronomy, in biology, and still more in psychol- 
ogy and sociology, our scientists can seldom measure directly 
the total phenomenon or result or development in which 
they are interested. Usually they must content themselves 


*“Educational Guidance Is Now Possible,” in The Educational Record, Vol. 
14, No. 4, October, 1933. 
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with measuring some aspect or incident or symptom, for which 
they have been able to devise a technique of measurement, 
and then draw inferences as to the meaning of their results 
with respect to the total process with which they are really 
concerned. In medicine, for example, what the physician really 
wants to measure is the progress of a disease or a cure. He 
can almost never do that directly, any more than we can meas- 
ure directly growth in power or improvement of social atti- 
tudes. But the physician does not therefore repudiate all 
measurement. On the contrary he assiduously and systemati- 
cally measures everything he can measure—temperature, pulse, 
blood count, urinal content, etc., and from his exact and com- 
parable data relating to these mere incidents and symptoms 
draws, by inference, important indications for diagnosis and 
therapy. In the field of education, where all the uncertainties 
of biology, psychology, and sociology are intermingled and 
concentrated, we can hardly complain if we must usually pro- 
ceed by a similar indirection. 

The application of all this to the use of information tests 
in progressive education will be obvious. Granted that as 
progressives we are not interested in information for its own 
sake, any more than the physician is interested in pulse or 
temperature as such, we may still be deeply and constantly 
interested in the results of factual tests for their indications of 
progress or lack of progress towards our own legitimate goals. 

Choosing to be tedious rather than to risk vagueness, I pro- 
pose to try to drive this point home—because it seems to me 
really important. It is the faith of progressives that if we 
faithfully employ in the teaching process and in curriculum 
building and in guidance the principles of interest and individ- 
ualization we shall attain an effectiveness in learning that 
cannot possibly be achieved when these principles are ignored, 
as they commonly are in much current schooling; that a student 
working in a particular field because of a genuine self-felt 
interest will master the material in that field with extraordi- 
nary thoroughness and precision and retain it with equally 
remarkable completeness and accuracy. True, we are not much 
interested in the mere volume of information thus acquired 
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and held in memory. We are interested rather because we 
believe that facts and ideas mastered in this way penetrate to 
the active intellectual life, as compelled rote learning never 
does, reach the emotions, develop what we call understandings 
and attitudes and appreciations, and eventuate in conduct and 
code. But incidental to the total process is the peculiarly effec- 
tive mastery of factual material in the student’s chosen field. 
And there is the one point in the whole process where we can 
at present test and obtain comparable quantitative data. We 
cannot do much perhaps in the measurement of interest at the 
beginning of the process, or anything at all as yet in the meas- 
urement of emotional reactions and understandings and appre- 
ciations at the end. But we do have in the standardized 
objective achievement test a sort of stethoscope which can be 
applied in the middle. And so it seems to me we ought to be 
eager and systematic in the use of that available instrument. 

If in particular cases we find a fine mastery of materials in 
the students’ chosen fields, we may be reasonably sure that 
we have been successful in our use of the principles of interest 
and individualization and are making progress towards our 
higher goals. And if in other cases the achievement tests un- 
cover ineffective learning even of facts—lI do not mean in all 
the usual fields, but in the chosen fields—then it seems to me 
we may well question whether we have been successful in our 
attempted use of progressive principles and whether we are 
on our way to progressive goals or any goals at all. 

I confidently expect, moreover, that if we will make free use 
of achievement tests—granting that they are mere informa- 
tion tests—in the schools now working under the Commission 
of the Progressive Education Association, and in other pro- 
gressive experimentation in school and college, we shall, by 
this device alone, demonstrate the overwhelming superiority 
of progressive procedures. It seems to me obvious in advance 
that students working eagerly and ardently in fields in which 
real interest has been aroused will acquire, even incidentally, a 
mastery of factual material in those fields surpassing anything 
that routine procedures can produce. I venture to assert that 
this has already been demonstrated at those colleges—Swarth- 
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more, Lehigh, and others—which have adopted the progres- 
sive device of the major field and the comprehensive exami- 
nation therein, and I am confident of the same outcome at the 
secondary level. 

In passing, let me call attention to the splendid strategic 
value, to the progressive cause, of thus beating the enemy on 
their own ground. 


V 


But we have still to examine the most serious objection 
which the radical progressives raise against the existing tests 
and—if I understand them correctly—against any conceivable 
tests, namely, that any testing program inevitably becomes 
itself the goal of instruction and hence dominates, standard- 
izes, stifles, and devitalizes the whole of the teaching process 
subjected to it. 

On this point we must, I think, admit that the objectors 
have history on their side. Such has certainly been the out- 
come of many notable testing programs in the past. We all 
know what the Regents’ Examinations have done to the high 
schools of the State of New York and what the College Board 
Examinations in their original form did to the whole group of 
Eastern preparatory schools. (Of course, it should be noted, 
in parenthesis, that the College Board situation is very dif- 
ferent now, since they have developed their comprehensive 
examinations and scholastic aptitude test, and with their newly 
proposed “qualifying examinations” we have, it seems to me, 
the first recorded case in natural history where the leopard 
has changed his spots. But to proceed.) The Pennsylvania 
Study, in giving new-type comprehensive examinations only 
three times in the colleges of Pennsylvania, uncovered pretty 
clear evidence of attempts to “coach” for those examinations. 
And all of us, working in either school or college, have watched 
general departmental examinations operate in the same way, 
becoming goals and standardizers for all the teachers and stu- 
dents in the department. It is not necessary to multiply 
examples. 

But it may be worth while to inquire whether these unhappy 
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results are inherent in the nature of tests and examinations 
themselves—whether they have not followed rather from the 
use we have hitherto made of tests and examinations. 

Up to the immediate present we have been accustomed to 
use examinations exclusively on crucial occasions, to be fol- 
lowed by immediate and drastic results for the examinee, based 
upon one spasmodic deliverance on his part under conditions 
of special stress and strain. We have used them to determine 
whether a man shall receive the degree of doctor of philosophy 
or the license to practice medicine or law; whether a college 
student shall be graduated; whether a high school boy may 
be admitted to the college of his choice; and at all levels 
whether students shall be promoted or left behind and be 
awarded praise or blame. 

So long as we use examinations and tests, of any type what- 
soever, in that fashion, I agree with the radical progressives 
that the examination program will inevitably become the actual 
goal of instruction for students and teachers alike, and will 
tend to defeat all or most worth-while educational purposes. 

But there is another possible way of using examinations and 
tests, which has been tried in part in a very few schools for a 
very few years, and which seems to me to conserve and enhance 
their measurement values and to avoid their dangers. And 
this brings me to that attempt at a constructive proposal of 
which I warned you at the beginning: a possible synthesis; a 
method of procedure in testing in educational experimentation 
which may solve the apparent dilemma. This suggestion is 
offered, I trust, with due modesty, certainly with some trepida- 
tion. It may serve at least as something to shoot at in the 
discussion group this afternoon. It is simply this: 


That in the schools working under the current project of 
the Progressive Education Association and in other progres- 
sive experimentation we should abandon once for all what I will 
call the end-examination: the examination or test of any kind 
given at the end of the student’s course, or at the end of the 
year or semester, or at other regular or stated intervals, to 
determine either in whole or in substantial degree graduation 


or failure to graduate, promotion or demotion, honors, prizes, 
demerits, exclusion, or the like. 
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But that we should by no means abandon examination and 
testing. 

That we should rather multiply examinations and tests, of 
many kinds, using them frequently, but always informally, casu- 
ally, and skeptically; record the results, of course; correlate 
and study these results; study particularly the patterns of 
results in each student’s cumulative record, in conjunction with 
personal impressions, teachers’ grades, or better teachers’ esti- 
mates, and all available facts in regard to the student’s back- 
ground and achievement; and base the necessary administrative 
decisions with respect to graduation, promotion, classification, 
and guidance on the total picture of the student’s abilities, 
aptitudes, character, and potentialities—to which total picture 
a considerable number of comparable test results would seem 
to me to contribute a vitally necessary part. 


I have said that in my opinion this kind of examining and 
testing would escape the dangers which have historically accom- 
panied examination procedures. The fact is that we humans, 
old and young, enjoy tests—provided we are not going to be 
hanged if we do badly. Please recall the vogue of the “Ask 
Me Another” books; the publishers found it worth while to 
issue three successive volumes. And every crossword puzzle 
is a test. So is every game of bridge or chess or billiards or 
tennis or golf—a competitive test of some kind of ability or 
achievement, and a test yielding comparable results. If all 
human games and sports partake of the nature of tests, why 
cannot we make of our necessary academic testing another 
school sport? We can do this if we dissever it from the extra- 
neous and illogical rewards and punishments which we have 
hitherto attached to it. The trouble is we educators have pro- 
fessionalized this sport of being tested. What we need to do 
is to give it the amateur status and keep it strictly amateur. 

To be concrete: it seems to me that if I were in charge of 
a school engaged in an educational experiment I should spring 
tests frequently throughout the year, using practically every 
kind that the Educational Records Bureau could find for me— 
psychological tests, aptitude tests, vocational interest tests, 
personality rating scales, and quite a lot of achievement tests. 
I think I should give some of the College Board Examinations, 
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which are probably the finest examinations of the subjective 
type which have ever been concocted or administered, and 
which have done harm only because of the purpose for which 
they have been used. And of course I should have all the 
results recorded on each student’s cumulative record. But I 
should not base any decision on any one result or any two or 
three results, but only on the total picture or diagram for the 
individual student, to which any one examination or test would 
contribute only a single stroke or dot. And because it would 
be known that that was the case, I believe the fear and strain 
of examinations and all thought of “coaching” for them or 
modifying procedures on their account would die out and they 
would take their place as an important amateur sport. 

Let me add, in conclusion, that if some such solution as this 
should enable the schools working in the current project of 
the Progressive Education Association to make full and free 
use of measurement and testing without injury to the freedom 
of experimentation, the student records sent up to the colleges 
would in my opinion—and I speak as the chairman of a com- 
mittee on admissions—prove so convincing and helpful that 
they would quickly supersede all other methods of admission. 

Obviously, also, such a solution would find us furnished at 
the end of the experiment with an ample body of definite and 
comparable data, to be used in a report which, we may hope, 
will prove the case for progressive education up to the hilt, 
and may lead to far-reaching changes in educational practice 
throughout the nation. 

Max McConn, 
Lehigh University. 





